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BACKGROUND 

The  September  11,  2001  terrorist 
attacks  on  the  World  Trade  Center 
and  the  Pentagon  have  thrust  the 
United  States  into  the  Global  War  on  Ter¬ 
rorism  (GWOT).  As  a  result  the  US  has 
joined  the  rest  of  the  world  by  entering  into 
a  new  age  of  instability.  The  current  strate¬ 
gic  environment  demands  that  our  armed 
forces  conduct  operations  simultaneously 
across  the  full  spectrum  of  conflict — from 
conventional  combat  in  major  contingency 
operations  like  OPERATION  IRAQI 
FREEDOM  (OIF)  to  peace  operations  such 
as  OPERATION  JOINT  FORGE.  Subse¬ 
quently,  the  value  of  analysts  who  support 
the  warfighter  has  and  will  continue  to  be 
a  significant  combat  multiplier  in  these 
efforts. 

Recent  experiences  in  providing  analyt¬ 
ic  support  to  the  combatant  commanders  in 
the  prosecution  of  the  GW OT  have  brought 
to  the  fore  several  areas  that  are  of  major 
importance  and  interest  to  the  warfighter. 
These  include: 

•  The  need  to  better  characterize  GWOT 
and  articulate  the  desired  endstate 
•  The  determination  of  nation  state  and 
regional  instability 
•  The  conduct  of  stability  operations 
•  Analytic  Tools  to  support  the  GWOT 
•  Metrics  of  Assessment  in  the  GWOT 
•  Homeland  Defense 

With  these  experiences  in  mind,  MORS 
hosted  a  workshop  on  analytic  support  to 
GWOT  at  the  Naval  War  College,  New¬ 


port,  RI  from  30  November  to  3  December 
2004.  The  workshop  provided  a  forum  for 
discussing  analytic  support,  tools  and  met¬ 
rics  of  assessment  in  the  Global  War  on 
Terrorism.  If  the  mark  of  a  good  MORS 
workshop  is  the  quality  and  diversity  of  the 
people  it  brings  together,  then  this  work¬ 
shop  was  a  huge  success.  The  GWOT 
workshop  brought  together  a  diverse  group 
of  analysts  and  decision  makers  from  with¬ 
in  DoD,  from  other  government  agencies, 
allied  nations,  industry,  and  academia.  The 
workshop  attracted  over  160  participants 
representing  each  service,  the  joint  staff 
and  OSD,  several  combatant  commands 
(COCOMs),  several  intelligence  organiza¬ 
tions,  the  Department  of  State,  and  the  US 
Agency  for  International  Development 
(USAID).  Participants  from  the  UK,  Israel, 
Sweden  and  Canada  were  also  included  in 
the  mix.  Several  participants  brought 
recent  in-theater  experience  in  OIF  and/or 
Operation  Enduring  Freedom  (OEF)  to  the 
table  as  well. 

WORKSHOP  OVERVIEW 

The  workshop  began  with  a  plenary  ses¬ 
sion  that  was  highlighted  by  thought  pro¬ 
voking  presentations  by  GEN  Wayne 
Downing  (plenary),  and  two  members  of 
the  Naval  War  College  faculty  -  Professor 
Jeff  Norwitz  (perspective  on  detainee 
operations  at  Guantanamo)  and  Professor 
Tom  Barnett  (author  of  The  Pentagon ’s 
New  Map),  Each  presentation  challenged 
the  audience  to  examine  current  national 
strategy  and  served  to  set  the  tone  for  the 
subsequent  working  group  sessions.  The 


plenary  session  also  included  a  panel  dis¬ 
cussion  that  focused  on  analytic  support  to 
decision  makers  in  theater  and  featured 
panelists  with  extensive  analytic  experi¬ 
ence  in  theater,  to  include  an  allied  per¬ 
spective. 

The  remainder  of  the  workshop  was  ded¬ 
icated  to  working  group  sessions  in  each  of 
the  6  areas  of  interest  listed  above.  A  syn¬ 
thesis  group,  consisting  of  senior  analysts, 
was  also  included  to  assess  insights  across 
all  of  the  working  groups  and  help  present 
a  consistent  set  of  workshop  findings.  The 
Homeland  Defense  working  group  con¬ 
centrated  their  effort  on  laying  the  ground¬ 
work  for  an  upcoming  Homeland  Defense 
MORS  Workshop  (tentatively  scheduled 
for  15-17  November  2005).  What  follows 
is  a  brief  synopsis  of  the  activities  and  con¬ 
clusions  from  the  other  five  working 
groups,  followed  by  some  conclusions 
drawn  by  the  synthesis  group. 

GWOT  PROBLEM  DEFINITION 
WORKING  GROUP 

This  working  group  focused  on  GWOT 
problem  definition.  The  group  reviewed 
current  strategic  guidance  and  available  lit¬ 
erature  and  developed  a  framework  for 
analysis.  Ideally,  this  group  should  have 
been  composed  of  Department  of  State  rep¬ 
resentatives,  policy  staff,  counter-terrorism 
intelligence  experts,  operators,  and  opera¬ 
tions  research  system  analysis  (ORSA) 
analysts.  In  practice,  the  group  had  limit¬ 
ed  regional  experience  and  was  heavily 
weighted  toward  operators  and  ORSA  ana- 
(See  WORKSHOP,  p.  31) 
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WORKSHOP 

(continued  from  p.  1) 

lysts  from  throughout  DoD.  Thus,  the  per¬ 
spective  of  the  group’s  effort  is  one  of  users 
of  policy  guidance.  The  group  attempted  to 
frame  and  comment  upon  existing  guidance 
and  open  literature  on  GWOT  to  offer  an 
analytic  perspective  that  may  be  of  assis¬ 
tance  to  national  leadership  and  in  future 
analytic  efforts.  The  working  group  rec¬ 
ommends  viewing  the  Global  War  on  Ter¬ 
ror  as  an  insurgency  within  Islam. 

The  existing  guidance  documents  are 
consistent  with  respect  to  the  overall  objec¬ 
tives  for  the  GWOT.  They  are: 

•  Defend  the  homeland 

•  Defeat  terrorist  networks 

•  Win  the  war  of  ideas 

However,  the  guidance  is  vague  on  the 
nature  of  the  conflict.  Chapter  12  of  the 
9/11  Commission  Report  is  very  direct  in  its 
criticism  of  the  policy  for  its  lack  of  clarity. 
The  title  ‘Global  War  on  Terror’  is  not  ana¬ 
lytically  productive  in  that  terrorism  is  a  tac¬ 
tic  to  achieve  an  end.  Beyond  a  criminal 
organization,  the  guidance  does  not 
describe  the  threat  or  source  of  conflict. 

Although  controversial  and  politically 
sensitive,  the  term  ‘insurgency  within 
Islam’  is  highly  descriptive  of  the  nature  of 
the  conflict.  It  provides  focus  on  the  threat, 
the  approach,  the  objectives,  and  a  frame¬ 
work  for  examining  US  and  community 
response.  It  is  important  to  note  that  this  is 
not  a  ‘war  against  Islam.’  This  is  a  conflict 
amongst  the  Muslim  community.  A1  Qaeda 
is  seeking  to  change  the  system  of  gover¬ 
nance  in  the  Muslim  world.  Ultimately,  it 
will  be  the  Muslim  community’s  decision 


to  accept  A1  Qaeda’s  vision,  continue  with 
its  current  regimes,  or  find  an  alternative. 

This  working  group’s  adoption  of  an 
insurgency  framework,  however,  is  not 
meant  to  suggest  a  disregard  for  the  growth 
of  transnational  threats  or  other  ‘terrorist’ 
organizations.  Multiple  views  support  an 
insurgent  framework,  including  the  9/1 1 
Commission  and  General  Downing’s  ple¬ 
nary  address  at  this  MORS  workshop.  It  is 
interesting  to  note  that  General  Downing 
participated  in  the  2002  drafting  of  the 
National  Strategy  for  Combating  Terrorism 
and  presented  an  insurgency  point  of  view 
during  his  presentation. 

Establishing  the  legitimacy  of  one’s  side 
is  central  to  winning  this  conflict.  Like  all 
politics,  insurgencies  are  local  in  nature. 
The  US  will  need  a  global  strategy,  yet 
needs  to  be  locally  flexible  at  the  opera¬ 
tional  and  tactical  levels.  Unlike  past  insur¬ 
gencies,  this  one  is  complicated  by  the  fol¬ 
lowing  issues: 

•  We  do  not  understand  the  bounds  of  this 
conflict.  If  there  are  any,  they  will  be 
determined  by  the  extremists; 

•  The  insurgency  appears  to  have  expan¬ 
sive,  nonnegotiable  political  aims; 

•  Weapons  of  mass  destruction  (WMD) 
and  other  technologies  have  changed  the 
calculus  of  this  insurgency;  and, 

•  The  insurgent  area  of  operations  has 
expanded  to  include  the  United  States, 
Europe,  and  the  rest  of  the  non-Islamic 
world. 

Additionally,  the  center  of  gravity  falls 
naturally  from  the  insurgency  framework. 
It  is  the  population,  both  theirs  and  ours. 
This  is  one  of  the  few  common  threads 
among  the  wide-range  of  historic  insurgen¬ 


cies.  The  best  means  for  success  is  for  the 
locals  to  recognize  the  need  to  win  for 
themselves. 

Recommendations 

The  problem  definition  working  group 
made  the  following  initial  recommenda¬ 
tions: 

First  Priority: 

•  Further  examine  US  National  Security 
Structure: 

-  What  is  the  US  structure  to  balance 
winning  the  war  of  ideas  and  killing 
terrorists  through  military  action? 

-  How  can  we  more  immediately 
improve  the  inter-agency  process  and 
share  data /  create  a  common  data  sys¬ 
tem  among  allies,  agencies,  and  depart¬ 
ments? 

Second  Priority: 

•  Understand  the  Muslim  Community: 

-  How  can  we  understand  and  utilize  the 
Muslim  Diaspora? 

-  Are  Leadership  exchanges,  such  as 
those  that  took  place  during  the  Cold 
War,  of  value? 

-  What  are  the  best  methods  to  under¬ 
stand  Muslim  cultural  boundaries  and 
how  might  we  shape  them? 

•  Wage  the  war  of  ideas: 

-  What  is  an  alternative  to  Bin  Laden  in 
the  eyes  of  Muslims? 

-  What  Islamic  de-programming  tech¬ 
niques  are  available? 

•  Educate  the  American  public: 

-  How  can  we  communicate  the  nature 
of  the  conflict? 

(See  WORKSHOP,  p.  32) 
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-  How  can  we  explain  the  potential  length 
of  the  conflict? 

Third  Priority: 

•  Define  DoD  Roles  and  Missions: 

-  How  can  the  military  effectively  be 
used  across  a  broad  range  of  missions 
to  address  the  conflict  (e.g.  assistance 
and  security)? 

FORECASTING  NATION-STATE 
AND  REGIONAL  INSTABILITY 
WORKING  GROUP 

The  forecasting  working  group  focused 
its  efforts  on  four  key  objectives: 

1.  Identify  and  review  analytic  approach¬ 
es,  tools  and  models  for  forecasting 
national  and  regional  instability. 

2.  Identify  decision  maker,  analyst,  and 
planner  information  requirements  at  var¬ 
ious  stages  of  operation  (no  intervention, 
intervention,  post-intervention). 

3.  Identify  gaps  between  what  analysts  and 
planners  NEED  and  what  current 
approaches,  tools,  and  models  currently 
provide. 

4.  Recommend  ways  to  fill  these  gaps. 

This  working  group  drew  a  distinction 
between  strategic  analysts  and  planners,  who 
have  a  long  term  perspective  and  need  to 
understand  cause-effect  relationships  in 
order  to  identify  the  relevant  drivers  of  insta¬ 
bility,  and  operational  analysts  and  planners 
who  have  a  short  term  perspective.  Work¬ 
ing  group  participants  agreed  that  a  fore¬ 
casting  approach  that  supports  strategic  ana¬ 
lysts  must  include  assessment  of  alternative 
policy  options.  They  also  agreed  that  it  is 
critical  for  operational  analysts  to  be  embed¬ 
ded  in  the  decision  maker’s  organization. 

Forecasting  Approaches 

The  group  examined  several  instability 
forecasting  models.  Strategic  forecasting 
models  are  macro-structural  in  their  orien¬ 
tation.  They  forecast  the  likelihood  that 
states  will  fail  or  will  become  unstable  from 
2  to  15  years  in  advance.  The  forecasts  are 
based  on  statistical  analyses  of  the  historical 
relationships  between  instability  and  macro- 
structural  trends  in  social,  political,  demo¬ 
graphic  and  economic  factors.  Examples 
include: 

•  Central  Intelligence  Agency  (CIA)  Polit¬ 


ical  Instability  Task  Force  (aka,  State 
Failure  Task  Force) 

•  CenterforArmy  Analysis’ ACTOR(Ana- 
lyzing  Complex  Threats  for  Operations 
and  Readiness)  model 
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Strategic  forecasting  models  provide 
accurate,  global,  systematic  analyses  of 
structural  conditions  conducive  to  instabili¬ 
ty.  They  provide  insights  into  which  coun¬ 
tries  are  likely  to  become  more  or  less  stable 
in  the  coming  years  given  trends  in  their 
underlying  conditions.  They  also  attempt  to 
identify  the  relevant  conditions  on  a  coun¬ 
try-specific  basis  that,  if  altered,  could 
enhance  (or  further  undermine)  national  sta¬ 
bility.  On  the  downside,  strategic  forecast¬ 
ing  models  only  provide  general  risk  propen¬ 
sities  for  countries  at  the  national  level  on  an 
annual  basis.  As  a  result,  they  provide  no 
insights  into  the  specific  timing,  nature,  and 
location  of  events  that  might  trigger  insta¬ 
bility.  They  are  based  on  correlations 
between  broad  conditions  and  instability.  As 
a  result,  they  cannot  identify  dynamic  causal 
chains.  Beyond  vague  generalizations,  these 
models  do  not  (and  cannot)  provide  com¬ 
pelling,  actionable,  course  of  action  analy¬ 
ses. 

Operational  forecasting  models  consist 
of  capabilities  that  monitor,  assess,  and  fore¬ 
cast  trends  in  dynamic  behavioral  interac¬ 
tions  between  people,  organizations,  and 
states.  Examples  include: 


•  ABC  Terrorism  Prediction  Model  (Psy- 
napse  Technologies).  This  model,  which 
has  been  operational  for  several  years, 
searches  through  textual  reports  for 
antecedents  or  precursors  to  terrorist 
attacks.  Using  neural  networks,  the  model 
can  estimate  the  timing,  target,  and  con¬ 
sequences  of  a  terrorist  attack  (within  the 
context  of  a  protracted  campaign)  with 
about  85%  overall  accuracy. 

•  Center  for  Army  Analysis’  FORECITE 
Monitor.  Collects  data  (in  near  real  time) 
on  who  is  doing  what  to  whom,  when, 
where  and  how  around  the  world.  The 
data  form  behavioral  indices  that  allow 
one  to  track  changes  in  the  character  and 
intensity  of  interactions  between  individ¬ 
uals,  organizations,  and  states. 

Operational  forecasting  models  are  char¬ 
acterized  by  their  ability  to  collect  and 
assimilate  substantial  data,  in  near  real  time, 
on  the  character  and  intensity  of  behavioral 
interactions  at  any  level  of  analysis  (indi¬ 
vidual,  organization,  state).  Their  predictive 
power  increases  as  historical  and  current 
data  become  available.  Some  operational 
forecasting  models  have  a  proven  track 
record  in  the  context  of  current  operations. 
However,  these  models  are  also  limited  and 
have  not  been  used  to  the  fullest  extent  of 
their  potential.  Though  we  have  made  some 
progress  in  our  ability  to  make  point  predic¬ 
tions  (ABC  Model),  the  operational  models 
are  generally  useful  only  for  analyzing  and 
forecasting  trends  in  behavioral  interactions 
(FORECITE).  These  models  do  not  yet 
facilitate  meaningful  course  of  action  assess¬ 
ments.  They  fail  to  provide  rigorous  insights 
into  causes  and  effects  of  instability  and 
require  manual  adaptation  to  system  pertur¬ 
bations. 

Gaps  and  Recommendations 

The  forecasting  working  group  identified 
several  gaps  between  what  decision  makers 
and  planners  need  and  what  forecasting 
approaches  are  currently  able  to  provide. 
The  group  centered  its  recommendations  on 
two  general  themes:  Analytical  support  to 
decision  makers  and  the  need  for  greater 
collaborative  relationships. 

ANALYTICAL  SUPPORT  TO 
DECISION  MAKERS  WORKING 
GROUP 

Contemporary  approaches  to  forecasting 
instability  do  not  currently  support  robust 
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course  of  action  assessments.  This  is  in 
some  measure  attributable  to  a  lack  of  data;  . 
the  data  we  need  are  not  being  collected,  or 
are  simply  not  available  for  use  by  the  ana¬ 
lysts  who  need  them.  Toward  that  end,  we 
offer  the  following  recommendations: 

•  Put  greater  emphasis  on  integrating  and 
sharing  data,  especially  on  an  interagency 
basis. 

•  Collect  new  data,  with  greater  emphasis 
placed  on  sub-national  level  indicators. 

We  know  a  great  deal  about  which  nation¬ 
al-level  conditions  are  portents  of  nation¬ 
al-level  instability.  If  we  could  collect 
data  on  these  same  factors,  more  fre¬ 
quently  and  at  the  local  or  provincial  level, 
we  could  forecast  the  timing  and  location 
of  instability  with  greater  precision. 

•  Increase  emphasis  on  transnational  actors. 
Academics,  US  government  agencies 
(Census  Bureau),  and  International  Gov¬ 
ernment  Agencies  (The  World  Bank)  have 
compiled  extensive  time  series  indicators 
that  describe  characteristics  of  countries. 
These  data  have  been  instrumental  in 
developing  national-level  forecasting 
models.  We  lack  comparable  levels  of 
analysis  other  than  the  nation-state  (like 
terrorist  groups). 

•  Fully  automate  the  collection  and  tagging 
of  event  data  and  event  antecedents.  Cur¬ 
rently,  those  few  analysts  who  have  time 
to  do  it  manually  generate  much  of  the 
most  useful  dynamic  behavioral  indica¬ 
tors.  The  lack  of  human  resources  devot¬ 
ed  to  developing  and  managing  these  data 
collections  limits  their  geographic  and 
temporal  scope.  We  have  made  tremen¬ 
dous  progress  in  our  ability  to  use  natural 
language  parsing  capabilities  to  automat¬ 
ically  collect  these  data  with  the  same 
accuracy  as  human  beings.  However,  we 
need  to  provide  greater  funding  to  projects 
that  have  demonstrated  this  ability. 

Collaborative  Relationships 

•  Between  government  and  academia. 

Currently,  instability  forecasting  models 
rely  on  data  collected  primarily  by  uni¬ 
versity-based  political  scientists  for  their 
own  purposes.  To  the  extent  that  the  gov¬ 
ernment  relies  on  these  data  for  its  insta¬ 
bility  forecasting  models,  it  needs  to  pro¬ 
vide  more  funding  to  keep  them  current. 
We  also  need  to  encourage  greater  partic¬ 
ipation  of  university-based  scholars  in 
forums  such  as  MORS,  especially  those 
from  the  “non-traditional”  ORSA  fields 


(like  political  science  and  sociology). 

■  Between  the  ORSA  and  Intelligence 
communities.  Forecasting  stability 
requires  both  intelligence  and  ORSA 
skills.  However,  there  is  very  little  mean¬ 
ingful  collaboration,  mutual  understand¬ 
ing,  or  appreciation  within  these  commu¬ 
nities  for  what  the  other  does.  Both 
communities  could  benefit  from  the 
development  of  forums  for  fostering 
greater  collaboration  and  understanding 
between  the  intelligence  and  ORSA  com¬ 
munities. 

•  Interagency.  Several  government  agen¬ 
cies — like  the  State  Department,  US 
Agency  for  International  Development 
(USAID),  Department  of  Defense  (DoD), 
and  Central  Intelligence  Agency  (CIA)  — 
have  similar  missions  with  respect  to  cri¬ 
sis  early  warning.  Their  research  and 
development  programs  are  highly  redun¬ 
dant  and  there  is  little  formal  interagency 
collaboration  to  coordinate  these  efforts. 
This  results  in  wasted  resources  and 
retards  the  incremental  advancement  of 
the  state  of  the  art  in  forecasting  instabil¬ 
ity.  We  should  strive  to  establish  an  inter¬ 
agency  task  force  for  early  warning  to 
coordinate  these  efforts. 

•  International.  Finally,  the  forecasting 
working  group  noted  that  there  is  a  great 
deal  of  interesting  work  being  done  in  this 
area  by  allied  and  friendly  countries,  such 
as  the  UK,  Switzerland,  Germany,  and 
Sweden.  Though  structures  exist  to 
exchange  information,  few  mechanisms 
exist  to  facilitate  meaningful  collabora¬ 
tion. 

ANALYTIC  SUPPORT  TO 
STABILITY  AND  TRANSITION 
OPERATIONS  WORKING  GROUP 

The  stability  and  transition  operations 
working  group  emphasized  the  fact  that  dif¬ 
ferent  types  of  “Phase  TV”  analyses  are  need¬ 
ed  at  different  levels.  Inside  the  Beltway  at 
the  Service  headquarters  and  Joint  Staff 
level,  analysis  should  be  involved  with 
determining  the  appropriate  force  level  and 
force  structure  for  stability  and  transition 
operations.  At  the  Combatant  Command 
level,  analysts  must  appreciate  and  highlight 
the  impact  that  courses  of  action  in  one 
phase  could  have  on  courses  of  action  in 
another  phase.  A  wide  range  of  models 
exists  to  support  and  evaluate  stability  and 
transition  operations.  The  diverse  analytic 
requirements  of  these  operations  are  such 


that  no  single  model  can  meet  all  of  them. 

It  is  important  to  understand  the  ramp- 
down  of  decisive  operations  and  the  ramp- 
up  of  stability  and  transition  operations.  Sta¬ 
bility  operations  are  the  link  between 
decisive  and  transition  operations.  Still,  the 
analyst  and  the  commander  will  be  using 
decisive  operations  EEAs  and  measure  of 
effectiveness  (MOEs)  concurrently  with 
transition  operations  MOEs.  It  is  difficult  to 
determine  when  one  phase  ends  and  anoth¬ 
er  begins. 

It  is  critical  to  synchronize  quantifiable 
elements  of  national  power  including  Host 
State  objectives  and  Intergovernmental 
Organization  (IGO)  and  Nongovernmental 
Organization  (NGO)  objectives.  The  com¬ 
mander  will  be  well  served  if  analysis 
describing  the  success  or  failure  to  support 
these  organizations  is  conducted.  At  the 
same  time,  the  IGOs  and  NGOs  need  to 
understand  that  they  will  have  to  adapt  to  be 
relevant.  The  same  is  true  regarding  host 
nation  support.  Too  often  analysis  is  con¬ 
ducted  concerning  the  US  or  coalition  capa¬ 
bilities,  but  the  host  nation  capabilities  are 
overlooked.  We  must  develop  a  joint  ana¬ 
lytic  doctrine  to  mutually  support  both  the 
warfighter  and  non-military  organizations. 

The  relationship  the  analyst  builds  with 
the  decision  makers  is  critical.  Deployed 
analysts  are  of  great  value.  We  as  a  com¬ 
munity  must  better  describe  what  we  can 
bring  to  the  table  for  the  other  elements  of 
the  staff. 

Additionally,  the  culture  of  analysis  on 
peace  operations  does  not  exist  outside  of  the 
military  as  it  does  within  the  military.  In 
OIF,  there  has  been  little  communication 
between  analysts  supporting  the  civilian 
leadership  and  military  leadership. 

Working  Group  Recommendations 

The  stability  and  transition  operations 
working  group  made  the  following  recom¬ 
mendations: 

•  Analysts  in  support  of  stability  and  tran¬ 
sition  operations,  especially  those  who  are 
deployed,  should  be  highly  skilled  in  the 
management  of  data,  VBA,  and  the  pres¬ 
entation  of  information; 

•  A  process  should  be  developed  to  famil¬ 
iarize  deploying  analysts  with  the  experi¬ 
ences  of  analysts  who  have  recently 
deployed,  and  to  enhance  reach-back 
capabilities  to  organizations  across  the 
analytic  community; 

(See  WORKSHOP,  p.  34) 
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WORKSHOP 

(continued  from  p.  33) 

•  Better  inform  senior  decision  makers 
about  ORSA  capabilities; 

•  Develop  a  joint  analytic  doctrine  to  sup¬ 
port  both  military  and  non-military 
organizations  and  facilitate  stability  and 
transition  operations  analysis  efforts 
between  military  commands,  non-mili¬ 
tary  agencies  and  the  host  nation;  and 

•  Initiate  a  dialogue  with  analysts  in  other 
governmental  agencies  to  integrate  their 
capabilities  in  stability  and  transition 
operations  analysis. 

GWOT  ANALYTIC  RESOURCES 
WORKING  GROUP 

This  working  group  focused  on  assessing 
current  and  emerging  analytic  tools  pertinent 
to  GWOT  analysis.  Figure  1  (on  page  31) 
shows  a  potential  assessment  framework  that 
the  group  brainstormed  after  initial  attempts 
to  bin  tools  into  a  more  traditional  strate¬ 
gic/operational/tactical  frame-work.  The 
working  group  was  divided  into  two  sub¬ 
groups  -  technologist’s  viewpoint  and  end 
user’s  viewpoint.  The  technologist  subgroup 
came  up  with  14  questions  that  the  tools 
should  address: 

1.  Where  and  when  are  terrorists  likely  to 
attack? 

2.  Who  are  the  terrorists? 

3.  How  are  terrorists  funded  (locate  and 
model  funding  streams)? 

4.  How  are  terrorists  resourced  (locate  and 
model  resource  streams)? 

5.  What  effects  will  actions  taken  against 
terrorists  have? 

6.  What  impact  will  a  “war  of  ideas”  have 
at  home  and  abroad? 

7.  How  do  we  detect  and  counter  decep¬ 
tion? 

8.  How  do  we  support  planning,  execution 
monitoring  and  assessment? 

9.  How  do  we  support  creating  strategy 
and  objectives? 

10.  How  do  we  do  adversary  modeling? 

1 1 .  How  do  we  construct  the  social  network 

of  parent  organizations?  . .  *■ 

12.  How  do  we  identify  individual  terrorist 
to  kill? 

13.  What  is  the  nature  of  GWOT? 

14.  What  metrics  do  we  need  to  develop? 

The  end  user  subgroup  came  up  with  five 
areas  that  are  of  interest  to  users: 

1.  Who  are,  or  will  be,  the  terrorists? 

2.  What  is  the  type  of  terrorism? 


3.  What  is  the  scale  of  terrorism? 

4.  What  will  be  the  impact  of  proposed 
blue  actions? 

5.  What  blue  actions  are  recommended? 
Observations 

•  The  group  agreed  that  the  quality  of  the 
analyst  is  more  important  than  the  quali¬ 
ty  of  the  tools. 

•  Tools  such  as  geographical  information 
systems  (GIS),  visualization  tools,  and 
collaborative  environments  can  be 
invaluable.  Similarly,  tools  that  reduce 
data  management  time  free  up  the  analyst 
to  concentrate  on  actual  analysis. 

•  Tool  quality  and  characteristics  varies 
widely. 

•  Combinations  of  tools  and  collabora- 
tion/reachback  will  be  needed. 

•  Traditional  OR  tools  will  be  useful  for 
GWOT,  but  we  need  some  new  ones  as 
well.  The  major  gaps  appear  to  be  at  the 
application  level,  rather  than  at  the 
methodology  level. 

•  We  need  to  take  a  broader  viewpoint  with 
respect  to  GWOT  than  we  have  in 
past  conflicts.  Other  communities  are 
involved  and  other  communities  can  help 
with  analytic  resources. 

The  group  is  in  the  process  of  preparing 
a  database  of  GWOT-relevant  tools  and 
resources  (data,  tools,  and  people)  that  will 
be  available  to  the  community.  The  data¬ 
base  currently  has  some  100  entries. 

METRICS  WORKING  GROUP 

This  working  group  attempted  to  devel¬ 
op  metrics  to  measure  military  effectiveness 
in  the  GWOT.  In  general,  metrics  can  be 
established  relative  to  three  basic  areas: 
Ends,  Ways,  and  Means.  “Ends”  metrics 
measure  progress  relative  to  a  stated  objec¬ 
tive;  “Ways”  metrics  measure  the  level  of 
activity  targeted  at,  or  thought  to  support, 
the  attainment  of  a  stated  objective;  and 
“Means”  metrics  measure  levels  of 
resources  dedicated  to  or  expended  in  sup¬ 
port  of  those  activities. 

The  group  used  the  following  Military 
Strategic  Objectives  (MSO)  as  defined  in 
the  National  Military  Strategic  Plan  for  the 
War  on  Terrorism: 

•  Establish  conditions  that  counter  ideo¬ 
logical  support  for  terrorism 

•  Defeat  terrorists  and  their  organizations 

•  Deny  terrorists  the  resources  they  need  to 
operate  and  survive 


•  Enable  partner  nations  to  counter  terror¬ 
ists 

•  Persuade,  coerce,  and  when  necessary, 
compel  states  and  non-states  to  cease  sup¬ 
port  for  terrorists 

•  Deny  WMD/E  proliferation,  recover  and 
eliminate  uncontrolled  materials,  and 
maintain  capacity  for  consequence  man¬ 
agement 

The  group  made  significant  progress  and 
identified  several  dozen  metrics  that  could 
provide  insight  on  whether  DoD  is  achiev¬ 
ing  the  MSOs.  These  metrics  have  been 
provided  to  15.  While  time  did  not  allow  the 
group  to  identify  metrics  relating  to  specif¬ 
ic  military  activities,  the  group  did  develop 
generic  metrics  to  relate  measures  of  mili¬ 
tary  activities  to  approved  endstate  metrics. 
Since  the  military  activities  vary  by  area  of 
responsibility,  it  may  be  more  effective  for 
the  joint  staff  to  task  the  COCOMs  to  report 
activity  levels  that  they  believe  have  the  best 
chance  of  positively  affecting  the  MSO  met¬ 
rics.  Then,  COCOM  levels  of  activity 
(“Ways”)  can  be  measured,  correlated  and 
adjusted  to  see  how  they  affect  respective 
MSOs.  Finally,  resource  expenditures 
(“Means”)  can  be  programmed  and  meas¬ 
ured  by  the  respective  services  to  determine 
the  costs  associated  with  obtaining  any 
MSO. 

Areas  for  Future  Emphasis 

While  this  working  group  made  good 
progress  toward  defining  an  initial  set  of 
objective  measures  from  which  we  can  track 
progress  in  the  GWOT,  much  remains  to  be 
done.  Among  the  areas  that  require  empha¬ 
sis: 

•  Fix  responsibility  for  data  collection. 
Much  of  this  responsibility  will  lie  out¬ 
side  of  DoD. 

•  One  focus  of  the  GWOT  is  the  “hearts 
and  minds”  of  the  people  we  are  assisting 
and  combating.  OR  techniques  within  the 
areas  of  civil  affairs  and  information  war¬ 
fare  need  to  be  developed.  A  good  way  to 
start  would  be  to  form  more  partnerships 
with  these  communities  in'Our  common 
efforts  in  the  War  on  Terror.  In  particular, 
within  the  working  group  there  was  a 
large  distrust  of  the  accuracy  of  current 
polling  methods. 

•  At  some  point  in  monitoring  GWOT 
progress,  human  judgment  becomes  nec¬ 
essary.  The  linkages  between  many  of  the 
identified  metrics  have  not  been  explored 
and  are  probably  a  ripe  area  for  the  devel- 
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opment  of  tools  and  approaches  to  evalu¬ 
ate  alternative  courses  of  action.  The 
working  group  did  not  feel  that  weighted 
scoring  approaches  would  be  sufficient  to 
adequately  address  this  need. 

CONCLUDING  REMARKS  FROM 
THE  SYNTHESIS  GROUP 

The  goal  of  the  GWOT  workshop  was  to 
provide  a  forum  for  discussing  analytic  sup¬ 
port,  tools,  metrics,  and  to  gain  insight  on 
operational  assessment  techniques  and  capa¬ 
bilities  to  better  support  the  GWOT.  On  that 
basis,  this  was  a  very  successful  workshop. 

General  Observations 

The  Global  War  on  Terror  presents  the 
Western  world  with  a  tremendous  challenge. 
We  are  confronted  with  an  insurgency  with¬ 
in  Islam.  All  working  groups  recognize  that 
our  fight  is  not  against  the  Islamic  Religion, 
but  with  extremists  within  Islam.  However, 
although  each  working  group  generally 
agrees  that  our  fight  is  not  against  Islam, 
they  often  use  words  that  make  it  sound  like 
it  is.  The  enemy  conducts  operations  against 
the  globalization  of  western  values  and 
influence.  This  makes  its  potential  targets 
very  large.  Counter  operations  are  difficult 
to  conduct  because  the  terrorist  threat  is  not 
hierarchical  in  nature.  It  is  a  collection  of 
loosely  networked  cells  that  act  independent 
of  each  other  and  any  chain  of  command. 
Further,  weapons  of  mass  destruction  and 
disruptive  technologies  magnify  the  risk  to 
our  populace  and  way  of  life. 

The  effectiveness  of  operations  conduct¬ 
ed  in  this  conflict  is  difficult  to  assess 
because  of  its  breadth.  It  is  far  easier  for  us 
to  assess  the  impact  of  a  particular  operation 
than  to  determine  that  operation ’s  impact  on 
the  global  war.  Yet,  we  need  to  think  glob¬ 
ally.  We  need  to  be  able  to  determine  the 
impact  of  yesterday’s  battle  in  Falujah  on 
tomorrow’s  fight  elsewhere.  Where  are  the 
analyses  to  determine  this  impact?  Who  is 
thinking  globally?  Where  is  the  organization 
that  is  advising  and  evaluating  the  use  of 
national  power  in  this  global  war?  We  can¬ 
not  afford  to  win  the  battle  but  lose  the  war 
or  lose  the  peace. 

We  need  to  define  an  endstate  for  GWOT. 
How  are  we  going  to  plot  a  path  to  get  there 
if  we  don’t  know  where  there  is?  The 
GWOT  is  winnable,  but  in  what  sense?  Will 
we  be  able  to  fully  eliminate  it?  Is  it  similar 
to  the  War  of  Poverty  or  the  War  on  Drugs? 
It  has  been  said  that  this  is  a  War  of  Gener¬ 


ations.  In  our  society  of  instant  gratification, 
short  attention  spans,  “I  want  it  yesterday” 
mentalities,  how  will  we  stay  the  course? 

We  need  to  understand  our  enemy.  This 
is  a  fundamental  difference  between  GWOT 
and  the  Cold  War.  At  the  height  of  the  Cold 
War,  if,  for  example,  you  brought  a  Com¬ 
munist  Politico  to  Wal-Mart,  he  would  be 
amazed  at  the  wealth  of  our  country  and  at 
what  an  open,  free  market  economy  can 
bring.  If  you  bring  a  terrorist  to  Wal-Mart, 
all  he  sees  is  an  example  of  the  decadence  of 
the  Great  Satan.  We  need  to  understand  the 
centers  of  gravity  of  our  enemy,  and  the 
environment  that  spawns  him  and  her.  And 
then,  based  upon  these  centers  of  gravity,  we 
need  to  perform  an  Intelligence  Preparation 
of  the  Battlefield.  Not  a  geographical  one, 
but  a  sociological  one  for  a  global  campaign 
plan. 

The  GWOT  will  not  be  won  through  mil¬ 
itary  power  alone.  It  will  require  all  the  ele¬ 
ments  of  our  national  power.  Where  do  we 
analyze  the  application  of  national  power? 

If  the  President  asks  the  DoD  to  solve  a  prob¬ 
lem,  he  gets  a  military  answer;  the  State 
Department,  a  diplomatic  one.  Where  do  we 
evaluate  the  apportionment  of  national 
power?  What  are  the  methodologies,  met¬ 
rics,  and  tools  to  assess  a  little  bit  of  this  and 
some  of  that? 

Our  role,  as  military  ORSAs,  in  the 
GWOT  presents  us  with  some  unique  and 
immediate  challenges.  The  DoD  is  not 
always  the  lead  in  addressing  certain  chal¬ 
lenges.  For  Homeland  Security,  civil  agen¬ 
cies  have  the  lead  and  DoD  is  supporting. 
For  the  GWOT,  the  Department  of  State  has 
the  lead.  Where  are  the  ORSAs  of  the  other 
agencies?  What  is  the  venue  in  which  we 
come  together  to  provide  support  to  our 
leaders?  In  what  context  can  we  assess  our 
ability  to  perform  in  this  supporting  role? 

All  the  working  groups  recognized  the 
need  for  interagency,  interdepartmental,  and 
international  cooperation  and  the  ability  to 
analyze  combined  actions.  However,  stove¬ 
pipes  and  the  lack  of  clearly  defined  respon¬ 
sibilities  make  this  difficult  For  example, 
local  law  enforcement  agencies  do  not  wish 
to  share  crime-fighting  infoimation  because 
of  their  “operational  security”  concerns.  We 
need  to  break  down  these  stovepipes  within 
our  own  government: 

There  is  a  real  concern  amongst  work¬ 
shop  participants  about  the  increasing  need 
for  analysis.  There  is  a  need  for  more  ana¬ 
lysts  within  the  Combatant  Commands  and 


analysts  who  understand  other  department 
and  agency  capabilities.  If  we  believe  that 
the  Global  War  on  Terror  is  a  fundamentally 
different  war,  and  a  war  of  generations,  what 
are  we,  as  a  MORS  community,  doing  to  pre¬ 
pare  ourselves?  The  phenomenology  of  this 
war  is  primarily  social,  not  physical.  What 
are  we  doing  to  obtain  the  necessary  social, 
political,  and  historical  training?  Operations 
Research  is  a  multidisciplinary  field.  How 
are  we  attracting  folks  with  the  right  back¬ 
grounds  and  expertise  into  our  community? 

Overarching  Recommendations 

•  Develop  a  campaign  analysis  plan  for  the 
Global  War  on  Terror  -  one  that  is  global¬ 
ly  strategic,  cross-community,  and  con¬ 
siders  all  the  elements  of  national  power 
of  the  US  and  our  allies. 

•  Identify  and  analyze  the  centers  of  gravi¬ 
ty  of  our  enemy.  Use  this  as  a  basis  to 
build  the  campaign  analysis  plan. 

•  Plan  for  the  long  term.  GWOT  will  like¬ 
ly  be  generations  in  length;  build  the 
analyses  plan  accordingly. 

•  Make  a  conscious  effort  to  expand  the  pool 
of  ORSA  talent  and  make  it  more  inter¬ 
disciplinary  with  the  social  sciences. 

»  Finally,  facilitate  the  coordination  of 
analyses  across  the  government  to  be  able 
to  analyze  the  use  of  national  power. 

CONTRIBUTORS 

(In  alphabetical  order) 

Dr  John  Borsi,  AFS  AA,  Metrics  WG 
Chair 

Mr  John  Cipparone,  Dynamics  Research, 
Analytic  Resources  WG 
Co-Chair 

Dr  Wm.  Forrest  Crain,  HQDA  G37, 
Workshop  Technical  Chair 
Mr  Thomas  Denesia,  NORTHCOM,  HLD 
WG  Chair 

Mr  Curt  Doescher,  Alion  Science  and 
Technology,  Organizing  Committee 
Member 

Dr  Stephen  G.  Downes-Martin,  US 
Naval  War  College,  Workshop  Co-Chair 
Dr  Karsten  Engelmann,  CAA,  Stability 
and  Transition  Operations  WG  Chair 
Dr  Dean  Hartley,  Hartley  Consulting, 
Analytic  Resources  WG  Chair 
Dr  David  Markowitz,  OSD  (PA&E), 
Problem  Definition  WG  Chair 
Dr  Lynee  D.  Murray,  NAVSEA  NUWC 
Div  Newport,  Workshop  Co-Chair 
Dr  Sean  O’Brien,  CAA,  Forecasting  WG 
Chair  O 


PHALANX 


6 


March  2005 


mms\ 


The  Global  War  on  Terrorism:  Analytical 
Support,  Tools,  and  Metrics  of 
Assessment 


Working  Group  1:  Forecasting  Nation-State 
and  Regional  Instability 


30  November  ■  2  December  2004 
US  Naval  War  College 
Newport,  Rhode  Island 


Purpose 


Military  Operations  Research  Society 


1.  Identify  and  review  analytical  approaches,  tools, 
and  models  for  forecasting  national  and  regional 
instability 

2.  Identify  analyst  and  decision  maker  informational 
requirements  at  various  phases  of  operation  (no 
intervention,  intervention,  post-intervention) 

3.  Identify  gaps  between  what  analysts  and  decision 
makers  NEED  and  what  current  approaches,  tools, 
and  models  currently  provide 

4.  Recommend  ways  ahead  to  fill  these  gaps 


These  are  the  four  objectives  of  Working  Group  1  (Forecasting  Nation-state  and 
Regional  Instability). 
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Scope 


Military  Operations  Research  Society 


Assessed  the  informational  requirements  of 
two  different  sets  of  analytical  consumers  at 
different  levels  of  analysis 


We  began  by  identifying  the  analysts,  planners  and  decision  makers  that  require 
early  warning  insights.  We  placed  them  in  one  of  two  categories  depending  on 
whether  they  had  a  strategic  or  operational  perspective. 
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H1SH5 


Strategic  Forecasting 


Military  Operations  Research  Society 


•  OSD  (policy),  NSC,  Joint  Staff  (J5  Strategy)  COCOMs,  State,  USAID, 
and  Coalition  partners 

•  Long-term  perspective  (5-20  years) 

•  Draw  “insights”  from  multiple  sources  using  multiple  methods 

•  Need  to  know  what  form  instability  will  take  (e.g.,  civil  war,  inter-state 
war,  revolution,  coups,  social  unrest,  economic  disruption) 

•  Decision  makers  emphasize  the  importance  of  identifying  causal 
factors  associated  with  instability  —  need  to  identify  key  drivers 

•  Need  to  provide  course  of  action  assessment 

♦  No  matter  how  accurate  the  underlying  analysis/model,  if  it  is  not 
accompanied  with  an  assessment  of  alternative  policy  options,  it  is  of 
questionable  relevance 

♦  Use  as  a  basis  for  making  long-term  policy  and  resource  decisions 


Strategic  analysts  and  planners  have  a  long-term  perspective  (5-20  years),  draw 
insights  from  multiple  products,  generally  need  to  know  what  form  instability 
will  take  (i.e.,  war,  economic  crisis,  social  unrest),  and  emphasize  the  need  to 
determine  cause-effect  relationships  in  order  to  identify  the  policy-relevant 
drivers  of  instability.  Participants  were  unanimous  in  thinking  that  any  relevant 
forecasting  approach  MUST  support  a  course  of  action  assessment;  no  matter 
how  precise  an  underlying  forecast,  if  it  is  not  accompanied  with  an  assessment 
of  alternative  policy  options,  it  is  of  questionable  relevance. 
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Operational  Forecasting 
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•  Short-term  perspective  (days  to  weeks)* 

•  Need  the  RIGHT  advice  NOW 

•  Timing  and  location  of  forecasted  adverse  actions  is 
critical 

•  Draws  insights  from  multiple  products 

•  Short-term  HARD  resource  decisions 

•  Need  to  measure  and  monitor  effectiveness 

•  Analyst  needs  close  proximity  to  the  decision  maker 
and  staff  (need  to  be  integral  part  of  team) 

*(vary  depending  on  proximity  to  intervention) 


Operational  analysts  and  planners  generally  take  a  short-term  perspective, 
seeking  insights  into  phenomena  that  will  occur  over  the  next  few  days,  weeks, 
and  in  some  cases  months.  Because  of  the  short  time  horizon,  operators  need  the 
right  advice  now.  As  a  result,  it  is  critically  important  that  the  analyst  be 
imbedded  in  close  proximity  to  the  decision  maker  and  his  staff.  The  timing  and 
location  of  impending  instability  needs  to  be  specified  with  precision  in  order  for 
the  operational  planner  to  efficiently  and  effectively  allocate  hard  resources. 
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“Models”  to  Conduct  Assessments 

Strategic  Forecasting  Models 

•  Most  are  macro-structural  in  orientation 

•  Forecast  the  likelihood  of  country  instability  and  state  failure  2-15 
years  in  advance  given  historical  relationships  (and  future 
forecasts)  of  broad  macro-structural  trends  in  social,  demographic, 
political,  and  economic  factors 

♦  Examples 

-  CIA  Political  Instability  Task  Force  (aka,  State  Failure) 

-  CAA’s  ACTOR 

Operational  Forecasting  Models 

•  Capabilities  to  monitor,  assess,  and  forecast  trends  in  dynamic 
behavioral  interactions  between  people,  organizations,  and  states 

♦  Examples 

-  Psynapse  Technologies’  ABC  terrorism  prediction  model 

-  CAA's  FORECITE  Monitor 

-  Georgia  Institute  of  Technologies’  Harbingers  of  Conflict  Program 


Military  Operations  Research  Society 


We  examined  several  instability  forecasting  models  to  determine  how  they  measured  up 
to  these  requirements.  We  placed  these  models  into  one  of  two  categories  depending  on 
whether  they  provided  strategic  or  operational  insights. 


Strategic  forecasting  models  are  macro-structural  in  their  orientation.  They  forecast  the 
likelihood  that  states  will  fail  or  will  become  unstable  from  2  to  15  years  in  advance.  The 
forecasts  are  based  on  statistical  analyses  of  the  historical  relationships  between 
instability  and  macro-structural  trends  in  social,  political,  demographic  and  economic 
factors.  Examples  include:  the  CIA  Political  Instability  Task  Force  (aka,  State  Failure 
Task  Force)  and  the  Center  for  Army  Analysis’  ACTOR  (Analyzing  Complex  Threats  for 
Operations  and  Readiness)  model. 

Operational  forecasting  models  consist  of  capabilities  that  monitor,  assess,  and  forecast 
trends  in  dynamic  behavioral  interactions  between  people,  organizations,  and  states. 
Examples  include:  • 

•  ABC  Terrorism  Prediction  Model  (Psynapse  Technologies).  This  model,  which 
has  been  operational  for  several  years,  searches  through  textual  reports  for 
antecedents  or  precursors  to  terrorist  attacks.  Using  neural  networks,  the  model 
can  estimate  the  timing,  target,  and  consequences,  of  a  terrorist  attack  (within  the 
context  of  a  protracted  campaign)  with  about  85%  overall  accuracy. 

•  Center  for  Army  Analysis’  FORECITE  Monitor.  Collects  data  (in  near  real  time) 
on  who  is  doing  what  to  whom,  when,  where  and  how  around  the  world.  The  data 
form  behavioral  indices  that  allow  one  to  track  changes  in  the  character  and 
intensity  of  interactions  between  individuals,  organizations,  and  states. 
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Evaluation  —  Current  Strategic 
Forecasting  Models 

•  Strengths 

♦  Provide  accurate,  global,  systematic  analyses  of  structural  conditions  conducive 
to  instability 

♦  Provide  insight  into  which  countries  are  likely  to  become  more  or  less  stable  in 
the  coming  years,  given  trends  in  their  underlying  conditions 

♦  Identify  the  relevant  conditions  on  a  country-specific  basis  that,  if  altered,  could 
enhance  (or  further  undermine)  national  stability 

•  Limitations 

♦  ONLY  provide  general  risk  propensities  FOR  COUNTRIES  at  the  national  level 
on  an  annual  basis 

-»  No  insights  provided  into  the  specific  timing,  nature,  and  specific  (sub¬ 
national)  location  of  triggering  events 

♦  Based  on  correlation  and  pattern  recognition  of  conditions  —  cannot  identify 
dynamic  causal  chains 

■»  Cannot  “predict’  triggers  or  relevant  internal  dynamics  years  in  advance 

♦  Beyond  vague  generalizations,  do  not  (and  cannot)  provide  compelling, 
actionable,  course  of  action  analysis 


li1©R5 
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We  then  evaluated  the  strengths  and  limitations  of  these  models.  The  strengths 
of  the  strategic  models  include  the  following: 

•  They  provide  accurate,  global,  systematic  analyses  of  structural 
conditions  conducive  to  instability. 

•  They  provide  insights  into  which  countries  are  likely  to  become  more  or 
less  stable  in  the  coming  years  given  trends  in  their  underlying  conditions. 

•  They  identify  the  relevant  conditions  on  a  country-specific  basis  that,  if 
altered,  could  enhance  (or  further  undermine)  national  stability. 

Limitations  of  the  strategic  forecasting  models  included  the  following: 

•  They  only  provide  general  risk  propensities  for  countries  at  the  national 
level  on  an  annual  basis.  As  a  result,  they  provide  no  insights  into  the 
specific  timing,  nature,  and  location  of  events  that  might  trigger 
instability. 

•  They  are  based  on  correlations  between  broad  conditions  and  instability. 
As  a  result,  they  cannot  identify  dynamic  causal  chains. 

•  Beyond  vague  generalizations,  these  models  do  not  (and  cannot)  provide 
compelling,  actionable,  course  of  action  analyses. 
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Evaluation  --  Current  Operational 
Forecasting  Models 
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•  Strengths 

♦  Collect  and  assimilate  data  in  near  real  time  on  the  character  and 
intensity  of  behavioral  interactions  at  any  level  of  analysis  (individual, 
organization,  state) 


♦  Predictive  power  increases  as  historical  and  current  data  become 
available 

♦  Some  models  have  a  proven  track  record  in  the  context  of  current 
operations 


•  Limitations 


♦  Some  progress  in  making  point  predictions  (ABC  Model),  but  generally 
useful  only  for  analyzing  and  forecasting  behavioral  trends 
(FORECITE) 

♦  Do  not  yet  facilitate  course  of  action  analysis 

♦  Do  not  provide  cause  and  effect  analysis 

♦  Require  manual  adaptation  to  system  perturbation 

♦  Have  not  been  used  to  the  fullest  extent  of  their  potential 


We  identified  the  following  strengths  in  the  operational  models: 

•  Their  ability  to  collect  and  assimilate  substantial  data,  in  near  real  time, 
on  the  character  and  intensity  of  behavioral  interactions  at  any  level  of 
analysis  (individual,  organization,  state) 

•  Their  predictive  power  increases  as  historical  and  current  data  become 
available. 

•  Some  models  have  a  proven  track  record  in  the  context  of  current 
operations. 

However,  we  also  noted  the  following  limitations: 

•  Though  we  have  made  some  progress  in  our  ability  to  make  point 
predictions  (ABC  Model),  the  operational  models  are  generally  useful 
only  for  analyzing  and  forecasting  trends  in  behavioral  interactions 
(FORECITE). 

•  These  models  do  not  yet  facilitate  meaningful  course  of  action 

assessments.  .  . 

•  They  do  not  provide  rigorous  insights  into  cause  and  effect  of  instability. 

•  They  require  manual  adaptation  to  system  perturbations. 

•  Nevertheless,  they  have  not  been  used  to  the  fullest  extent  of  their 
potential. 


Gaps  and  Recommendations 
(Analytical  Support) 

•  Analytical  Support  to  Decision  Makers 

♦  Data  collection  and  availability 

♦  Current  approaches  fail  to  address  courses  of  action 

♦  Recommendations 

Integrate/share  existing  data 

Collect  new  data--increase  emphasis  on  sub-national  level 
indicators 

Increase  emphasis  on  transnational  actors 

Fully  automate  the  collection  and  tagging  of  event  data  and  event 
antecedents 

Greater  use  of  experimentation  in  the  short-term  to  illuminate 
cause  and  effect  relationships. 


Military  Operations  Research  Society 


We  identified  several  gaps  between  what  decision  makers  and  planners  need  and  what  forecasting 
approaches  are  currently  able  to  provide.  We  centered  our  recommendations  on  two  general 
themes:  Analytical  support  to  decision  makers  and  the  need  for  greater  collaborative  relationships. 

Analytical  Support  to  Decision  Makers 

Current  forecasting  approaches  do  not  currently  support  robust  course  of  action  assessments.  This  is 
in  some  measure  attributable  to  a  lack  of  data;  the  data  we  need  are  not  being  collected,  or  are 
simply  not  available  for  use  by  the  analysts  who  needs  them  for  forecasting.  We,  therefore,  offer  the 
following  recommendations. 

Greater  emphasis  on  integrating  and  sharing  data,  especially  on  a  cross-agency  basis 

Collecting  new  data,  with  greater  emphasis  placed  on  sub-national  level  indicators.  We  know  a 
great  deal  about  which  national-level  conditions  are  portents  of  national-level  instability.  If  we 
could  collect  data  on  these  same  factors,  more  frequently  and  at  the  local  or  provincial  level,  we 
could  forecast  the  timing  and  location  of  instability  with  greater  precision. 

Increase  emphasis  on  transnational  actors.  Academics,  US  government  agencies  (Census  Bureau), 
and  International  Government  Agencies  (The  World  Bank)  have  compiled  extensive  time  series 
indicators  that  describe  characteristics  of  countries.  These  data  have  been  instrumental  in 
developing  national-level  forecasting  models.  We  leek  comparable  data  for  units  of  analyses  other 
than  the  nation-state  (like  terrorist  groups). 

Fully  automate  the  collection  and  tagging  of  event  data  and  event  antecedents.  Currently,  those  few 
analysts  who  have  time  to  do  it  generate  much  of  the  most  useful  dynamic  behavioral  indicators 
manually.  The  lack  of  human  resources  devoted  to  developing  and  managing  these  data  collections 
limits  their  geographic  and  temporal  scope.  We  have  made  tremendous  progress  in  our  ability  to  use 
natural  language  parsing  capabilities  to  automatically  collect  these  data  with  the  same  accuracy  as 
human  beings.  However,  we  need  to  provide  greater  funding  to  projects  that  have  demonstrated  this 
ability. 
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Gaps  and  Recommendations 
(Collaborative  Relationships  1) 
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•  Between  Government  and  Academia 

♦  Currently,  forecasting  capabilities  reiy  on  data  collected  by  the  academic 
community  for  their  own  purposes 

♦  Recommendations 

■»  Greater  government  funding  for  academic  data  collections 

Provide  additional  forums  and  encourage  greater  participation  of  academics 
from  “non-traditiona!"  ORSA  fields  (political  science) 

•  Interagency  (ORSA  and  intelligence) 

♦  Forecasting  requires  intelligence  analyst  and  ORSA  skills 

■»  Very  little  collaboration,  mutual  understanding,  or  appreciation  across  these 
communities 

“Data",  “ analysis ”  and  “ validation ”  mean  different  things  to  the  intelligence 
and  ORSA  communities 

♦  Recommendations 

ORSAs  need  to  be  intelligence  analysts  and  intelligence  analysts  need 
ORSA  skills 

Greater  embedding  of  ORSAs  within  intelligence  schools 
-*  Might  require  outreach  between  the  two  communities 


Collaborative  Relationships 

Between  government  and  academia.  Currently,  instability  forecasting  models 
rely  on  data  collected  primarily  by  university-based  political  scientists  for  their 
own  purposes.  Due  to  a  lack  of  funding,  these  data  sets  sometimes  are  not 
updated  for  5  or  10  years,  which  limits  their  ability  to  be  used  in  forecasting 
models. 

•  Recommendation:  To  the  extent  that  the  government  relies  on  these  data 
for  its  instability  forecasting  models,  it  needs  to  provide  more  funding  to 
keep  them  current.  We  also  need  to  encourage  greater  participation  of 
university-based  scholars  in  forums  such  as  MORS,  especially  those  from 
the  “non-traditional”  ORSA  fields  (like  political  science  and  sociology). 

Between  the  ORSA  and  Intelligence  communities.  Forecasting  stability 
requires  both  intelligence  and  ORSA  skills.  However,  there  is  very  little 
meaningful  collaboration,  mutual  understanding,  or  appreciation  within  these 
communities  for  what  the  other  does.  Even  the  words  data,  analysis,  and 
.validation  mean  very  different  things  to  the  ORSA  and  intelligence  analyst. 

•  Recommendation:  ORSAs  need  to  be  intelligence  analysts  and 

intelligence  analysts  need  some  ORSA  skills.  Both  could  benefit  from  the 
development  of  forums  for  fostering  greater  collaboration  and 
understanding  between  the  intelligence  and  ORSA  communities.  Such 
forums  could  lead  to  the  introduction  of  an  “ORSA-type”  curriculum 
within  the  intelligence  schools. 
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Gaps  and  Recommendations 
(Collaborative  Relationships  2) 
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•  Interagency  (Overall) 

♦  Different  agencies  have  similar  missions 

-»  State,  USAID,  DoD,  CIA  are  all  perusing  some  kind  of  early  warning 
program 

•»  Lots  of  duplication,  VERY  little  analytical  collaboration  (NIH?) 

*  Results  in  wasted  resources 

Retards  incremental  advancement  of  the  state  of  the  art 

♦  Recommendation 

■*  Develop  an  interagency  task  force  for  early  warning  to  coordinate  efforts 

•  International 

♦  Lots  of  interesting  work  being  done  by  allied  and  friendly  countries  (UK, 
Sweden,  Switzerland,  Germany) 

♦  Structures  exist  to  “exchange"  information,  but  few  mechanisms  exist 
to  facilitate  meaningful  collaboration 


Interagency  (overall).  Several  government  agencies — like  the  State  Department, 
US  Agency  for  International  Development  (USAID),  DoD,  and  CIA— have 
similar  missions  with  respect  to  crisis  early  warning.  Their  research  and 
development  programs  are  highly  duplicative  and  there  is  very  little  formal  inter¬ 
agency  collaboration  to  coordinate  these  efforts.  This  results  in  wasted  resources 
and  retards  the  incremental  advancement  of  the  state  of  the  art  in  forecasting 
instability. 

•  Recommendation:  Develop  an  interagency  task  force  for  early  warning 
to  coordinate  these  efforts. 

International.  Finally,  we  noted  that  there  is  a  lot  of  interesting  work  being 
done  in  this  area  by  allied  and  friendly  countries,  such  as  the  UK,  Switzerland, 
Germany,  and  Sweden.  Though  structures  exist  to  “exchange”  information,  few 
mechanisms  exist  to  facilitate  meaningful  collaboration. 
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The  Global  War  on  Terrorism:  Analytical 
Support,  Tools,  and  Metrics  of 
Assessment 


Working  Group  2:  Analytic  Support  to 
Phase  IV  Operations 


30  November  -  2  December  2004 
US  Naval  War  College 
Newport,  Rhode  Island 


Working  Group  2:  Analytical  Support  to  Phase  IV  Operations,  was  chaired  by  Dr. 
Karsten  Engelmann,  from  the  Center  for  Army  Analysis  (CAA).  The  co-chairs 
were  MAJ  Robert  Kewley,  CAA,  MAJ  Andy  Famser,  Army  QDR  office,  and  Mr. 
Steve  Stephens,  Marine  Corps  Studies  and  Analysis.  The  working  group  was  well 
attend,  with  up  to  30  individuals  from  government  and  industry.  The  attendees 
were  divided  evenly  between  uniform  and  non-uniform  personnel.  One 
interesting  aspect  of  the  group  is  the  great  number  of  formerly  deployed 
individuals,  as  well  as  deploying  individuals. 
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WG  2  Chairs  and  Co-Chairs 


•  Chair:  Dr.  Karsten  Engelmann 

(703)  806-5532,  engelmann@caa.army.mil 

•  Co-Chairs:  MAJ  Rob  Kewley 

(703)  806-5562,  kewley@caa.army.mil 

•  Mr.  Cortez  “Steve”  Stephens 

(703)  784-6029,  cortez.stephens@usmc.mil 

•  MAJ  Andy  Farnsler 

(703)  695-1102,  andrew.farnsler@us.army.mil 
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WG  2  Agenda 


•  Overview 

•  Working  group  objectives 

•  Conclusions 
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•  Future  workshops 
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Overview 


WG  2  Assignment  (from  MORS) 
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•  Each  working  group  will  present 

♦  A  recommended  analysis  approach  for  each  of  their  topics, 
including  a  course  of  action  for  implementing  the  approach 

♦  These  suggested  approaches  will  identify  current  tools,  models, 
methods  and  metrics  that  may  be  used  in  assessing  the 
effectiveness  of  the  GWOT 

For  example;  how  successful  are  we  at  disrupting  the 
financial  flows  of  terrorist  organizations?  How  do  we  measure 
the  progress  of  stability  operations? 

♦  This  will  provide  a  basis  for  building  a  library  of  appropriate 
assessment  tools 

♦  Further,  recommendations  for  future  workshops  and  working 
group  meetings  that  will  concentrate  on  specific  areas  will  be 
proposed  for  Sponsor  consideration 
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•  Focus  Areas 

♦  The  transition  from  major  combat  operations  (MCO)  to  counter¬ 
terrorism  and  counter  insurgency 

♦  Supporting  a  political  process  that  is  both  appropriate  to  the 
region  and  culture  that  enhances  security 

♦  Predicting  the  actions  of  global  terrorists  in  the  nation  or  region 
after  major  combat  operations  and  after  the  US  has  withdrawn 

♦  Predicting  what  kind  of  actions  during  Phase  II  and  III  will  best 
support  Phase  IV  operations  after  Phase  III 

•  Objectives  (what  we  accomplished) 

♦  Identify  the  over-lap  area  between  Phase  II  and  III  and  Phase  IV 
Operations 

♦  Identify  how  analysts  can  better  serve  decision  makers  during 
Phase  IV  Operations 

♦  Identify  applicable  models  and  tools 


WG  2  Overview 


The  focus  areas  were  only  tangentially  touched  on.  The  main  emphasis  was  the  objectives. 
The  group  overall  felt  that  the  focus  areas  were  appropriate.  The  one  exception  was  that 
additional  time  and  emphasis  should  be  placed  on  the  interaction  between  the  military  and 
the  other  elements  of  power.  This  is  especially  true  when  dealing  with  non-govemmental 
organizations  and  inter-governmental  organizations. 

Overall,  the  military  is  able  to  bring  assets  to  the  “show”  that  the  other  organizations 
interested  in  alleviating  conflict  and  the  problems  caused  by  conflict,  are  unable  to.  For 
example,  the  military  is  able  to  bring  far  more,  and  better  equipped  security  forces  to  a  re¬ 
construction  (Phase  IV)  effort  than  IGOs/NGOs/PVOs  are  able  to.  Additionally,  the 
military,  through  its  inherent  capabilities,  brings  some  limited  construction  capability  to  the 
re-construction  effort.  Another  very  strong  area  that  the  military  is  able  to  assist  in  is  the 
establishment  of  communications,  and  the  ability  to  coordinate  the  disparate  organizations 
involved  in  the  reconstruction  effort.  This  is  facilitated  by  the  strong  management  skills  that 
senior  (and  even  junior)  officers  have.  Other  areas  where  the  military  is  ideal  for  Phase  IV 
operations  is  in  the  training  of  security  forces  to  enable  the  host  nation  to  take  over  the 
defense  of  their  own  country.  Finally,  because  of  its  structure,  the  military  is  often  the  best 
choice  for  the  creation  of  a  separate,  specialized  Phase  IV  headquarters  under  which  the 
Inter-governmental  organizations  (IGOs),  Non-govemmental  organizations  (NGOs)  and 
Private  Venture  Organizations  (PVOs)  may  operate. 

Thus,  it  could  be  argued  that  this  list  of  objectives  needs  to  be  expanded. .  .and  the  focus 
area  needs  to  be  taken  off  of  the  military  and  onto  the  other  elements  of  power.  To 
accomplish  this,  we  will  need  to  be  inclusive  of  other  organizations  (state,  IGOs,  NGOs, 
PVOs)  and  their  analytical  capabilities.  An  inter-agency  analytical  huddle  similar  to  this 
MORS  workshop  is  necessary,  and  should  include  not  only  DoD,  but  also  other 
governmental  representation,  and  even  non-govemmental  representation. 
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They  Pertain  to  WG  2 
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•  How  to  present  analysis  to  the  decision  maker 

•  Facing  a  global  counter-insurgency  campaign 

•  Not  getting  at  the  root  cause 

•  The  Strategic  Goal:  4  D’s 

•  Establish  the  relationships 

•  Suggest  alternatives 

•  Model  on  a  strategic  world-wide  basis 

•  Is  the  cost-benefit  ratio  against  us? 

•  Are  we  winning  or  losing? 

•  Inter-agency  cooperation  is  at  an  all  time-low 


The  plenary  speakers  presented  a  number  of  points  that  are  cognizant  with  respect 
to  the  WG  2  objectives.  GEN  Downing  (ret)  asked  the  question  of  how  we  are 
going  to  get  at  the  root  causes  of  the  underlying  conditions  that  enable  the 
international  and  state  sanctuaries  to  exist  that  are  supporting  terrorist 
organizations  and  their  leadership.  He  mentioned  the  4  D’s  of  strategic  goals: 
Defend,  defeat,  deny,  and  diminish.  We  need  to  be  able  to  analyze  how 
successful  we  are  in  diminishing  the  underlying  conditions,  denying  international 
and  state  sanctuaries,  and  finally  defeating  the  terrorist  organizations  and  its 
leadership  GEN  Downing  (ret)  emphasized  the  importance  of  presenting  analysis 
to  the  decision  maker.  This,  of  course,  is  the  most  important  aspect  of  analysis. 
Analysis  that  is  not  presented  in  a  concise  manner  to  a  decision  maker  does  not 
help  the  decision  maker.  Furthermore,  an  analyst  that  does  not  win  the  trust  of  the 
decision  maker  will  be  unable  to  make  an  impact  on  the  decision  makers  actions. 
This  leads  into  an  idea  that  will  be  explored  later  -  the  competency  of  the  analyst. 
A  competent  analyst  must  not  only  be  able  to  produce  analytically  rigorous 
products,  but  must  also  be  able  to  present  those  products  in  a  convincing  manner 
that  enables  the  decision  maker  to  act  on  the  ideas  presented. 

War  on  terrorism  is  a  war  on  a  tactic  -  and  declaring  war  on  a  tactic  is  hazy.  We 
are  facing  a  global  war  not  on  terrorism. .  .but  on  terrorists  -  insurgents  within 
Islam. 
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Levels  and  Geographical  Places  of 
Phase  IV  Analysis 
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•  Multiple  locations  and  types  of  analysis 

♦  Beltway  type  of  analysis 

What  forces  do  you  need  to  accomplish  a  mission?  Size  and  skill 
sets 

What  skill  sets  do  analysts  need  to  support  the  combatant 
commanders? 

What  tools  do  we  need  to  build? 

♦  At  the  COCOM  level 

Analysis  to  support  planning  (Phase  I,  II,  III  and  IV) 

Analysis  to  support  course  of  action  (Phase  I  effects  II,  III,  etc.) 

♦  In  the  field  with  the  commander 

Assessment  and  combat  assessment 
-  How  well  are  we  doing,  or  how  poorly  are  we  doing 

•  What  analysis  are  IGO/NGO/PVOs  conducting? 


Different  types  of  Phase  IV  analyses  are  needed  at  different  levels.  Inside  the 
Beltway  at  the  Service  headquarters  and  Joint  Staff  level,  Phase  IV  analysis 
should  be  involved  with  determining  the  appropriate  force  level  and  force 
structure  for  Phase  IV  analysis.  This  type  of  analysis  would  include  determining 
types  and  amounts  of  skill  sets  needed.  In  addition,  this  type  of  analysis  could 
include  determining  equipment  requirements  for  Phase  IV  operations.  This  type 
of  analysis  could  impact  program  development. 

At  the  Combatant  Command  level,  analysis  could  be  used  to  support  the  planning 
process  of  operations  from  Phase  0  all  the  way  through  Phase  IV  and  highlight 
the  impact  that  courses  of  action  in  one  phase  could  have  on  courses  of  action  in 
another  phase. 

At  the  Joint  Task  Force  level  and  below,  Phase  TV  analysis  is  needed  for 
assessment  and  decision  support.  Logistics  analysis  is  as  critical  in  Phase  IV  as 
in  the  other  phases  and  may  be  more  so. 
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Identify  the  overlap  area  between 
Phase  II  and  III  and  Phase  IV  Operations 

•  Summary 

♦  Identify  the  questions  that  need  to  be  asked  about  Phase  IV  and 
applied  to  Phase  III.  Need  to  be  able  to  explain  the  “so  what’s"  from 
Phase  IV  analysis  to  Phase  111  analytical  efforts 

*  Phase  III  and  Phase  IV  are  often  simultaneous  operations 
Need  to  be  analytically  involved  from  the  beginning  (Phase  0?) 

♦  Analysis  occurs  pre-campaign  at  Beltway  level  for  planning  and 
force  structure  development 

♦  Need  to  make  sure  non-military  organizations  understand  military 
lingo  and  vice-versa 

♦  Provide  the  means  for  good  force  planning  for  Phase  IV.  It  needs  to 
be  simple  to  use  and  understand 


Important  to  discover  and  understand  the  ramp-down  of  Phase  III  and  the  ramp-up  of 
Phase  IV  operations.  Stability  operations  are  the  link  between  Phase  III  and  Phase  IV. 
Still,  the  analyst  and  the  commander  will  be  using  Phase  III  EEAs  and  MOEs  along 
with  the  Phase  IV  MOEs.  There  is  a  lot  of  overlap  between  the  two.  In  fact,  it  is 
difficult  to  determine  when  Phase  III  ends  and  when  Phase  IV  begins.  It  can  be  argued 
that  a  new  phase-less  approach  needs  to  be  identified.  As  was  pointed  out  by  Dr.  Rose, 
the  end  states  need  to  be  well  defined.  This  can  be  difficult  because  an  end  state  for  a 
phase  may  be  declared  (as  in  Iraq),  but  the  campaign  may  slip  back.  There  probably 
needs  to  be  triggers  to  determine  when  we  move  from  Phase  III  to  Phase  IV.  We  need 
to  develop  a  joint  analytic  doctrine  to  support  the  war  fighter  and  non-military 
organizations  both. 

One  important  element  is  the  matter  of  intelligence,  as  COL(P)  Keller  pointed  out,  we 
need  to  spend  less  time  in  the  intelligence  cycle  on  managing  information  and 
commensurately  more  time  on  analyzing  information.  This  is  true  for  Phase  III 
analysis  as  well  as  Phase  IV.  The  question  remains,  are  the  informational  elements 
appropriate  for  Phase  III  also  for  Phase  IV?  How  do  Intelligence  and  Intelligence 
gathering  systems  change  from  Phase  III  to  Phase  TV.  What  resources  change  from 
Phase  III  to  Phase  TV.  This  needs  to  be  identified  and  understood.  For  example  how 
does  the  troop  to  task  change  over  time  as  you  change  phases.  We  don’t  need  a  huge 
model  to  generate  the  results.  How  do  we  make  choices.  What  higher  level  subjects 
would  be  useful. 
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Identify  the  over-lap  area  between 
Phase  II  and  III  and  Phase  IV  Operations 

•  Important  Elements 

♦  Need  tools  that  synchronize  quantifiable  elements  of  national  power 
(DIME).  These  include 

Host  State  objectives  and  Interests 
Commander(s)’  priorities/top  ten 
■*  Coalition  members  objectives  and  red  lines 
■»  Inter-governmental  Organization/Nongovernmental  Organization 
objectives  (how  to  include  them  into  the  evaluation  process) 

♦  Information  operations  -  conducted  in  Phase  III,  but  often  shows  up 
in  Phase  IV.  Content  analysis  and  polling 


One  issue  that  needs  to  be  addressed  is  the  need  to  synchronize  quantifiable  elements 
of  national  power  including  Host  State  objectives  and  Inter-governmental 
Organization  and  Nongovernmental  Organization  (IGO/NGO)  objectives.  The 
commander  will  be  well  served  if  analysis  describing  the  success  or  failure  to  support 
these  organizations  is  conducted.  At  the  same  time,  the  IGOs/NGOs  need  to 
understand  that  they  will  have  to  adapt  to  be  relevant.  Their  sometimes  reluctance 
regarding  working  with  the  military  will  need  to  be  reduced. .  .and  greater  ties 
between  the  two  groups  established.  The  same  is  true  regarding  host  nation  support. 
Too  often  analysis  is  conducted  concerning  the  US  or  Coalition  capabilities,  but  not 
taking  into  consideration  the  host  nation  capabilities. .  .and  if  those  capabilities  are 
increasing  or  decreasing.  It  is  understood  that  data  gathering  on  these  organizations 
is,  at  best,  difficult. 

Analysis  support  during  the  planning  for  and  conduct  of  Phase  II  operations  and 
Phase  III  operations  could  indicate  impacts  on  Phase  IV  operations.  Analyses 
supporting  Information  operations  would  be  very  useful,  but  there  is  not  much 
analysis  done  pertaining  to  Information  Operations  (10).  More  needs  to  be  done 
analyzing  10  not  just  for  Phase  IV,  but  also  for  the  preceding  phases  and  their 
eventual  impact  on  Phase  IV 10  and  Phase  IV  operations  in  general.  It  is  critical  that 
information  operations  are  consistent  throughout  all  phases. 
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to  Better  Serve  Decision  Makers 
During  Phase  IV  Operations 

•  Summary 

♦  Understand  decision  maker's  objectives  and  priorities 

♦  Assist  the  decision  maker  in  determining  progress  towards  the  end- 
state  and  resource  allocation  to  meet  prioritized  goals 

♦  Understand  data  requirements  Phase  IV  operations 

•  Important  Elements 

♦  Need  for  measures  that  are  scalable  between  levels  of  command 
(tactical,  operational,  strategic,  national) 


We  need  to  ensure  that  we  not  only  have  the  analysis  but  also  the 
recommendations  for  the  commander  and  explanations  for  the  commander.  We 
need  to  understand  the  commander’s  plan.  However,  what  do  we  do  in  situations 
where  the  commander  may  not  have  a  plan,  or  a  plan  that  changes  over  time?  The 
analyst  needs  to  continue  to  be  flexible,  and  be  willing  to  take  sucking  chest 
wounds  bringing  analysis  to  the  commander.  The  commander  is  not  the  only 
decision  maker.  For  example,  the  chief  of  staff,  as  well  as  the  J3  or  G3. 

Analysis  to  support  Phase  IV  planning  begins  with  the  analysis  to  support  Phase  I 
planning.  The  analysis  to  support  selection  of  courses  of  action  for  Phase  II 
planning  and  Phase  III  planning  should  incorporate  the  effect  of  Phase  II 
operations  and  Phase  III  operations  on  Phase  TV  operations.  Analysis  can  simulate 
alternative  exit  criteria  for  Phase  IV.  There  is  a  Maslow  Hierarchy  type  of 
structure  that  is  characteristic  of  Phase  IV  operations  that  can  be  exploited  by 
analysis.  Numbers  that  are  derived  subjectively  in  the  analysis  process  should  not 
be  presented  to  the  decision  maker  in  numerical  format.  A  ‘stoplight’  presentation 
should  be  used  with  strong  textual  support  for  assessments. 
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Identify  Appropriate  Models 
and  Tools 


•  Summary 

♦  Due  to  the  diversity  of  Phase  IV  operations,  no  single  model  can  be  a  panacea 
for  analytical  support  to  Phase  IV  operations  (a  family  of  models  is  needed) 

♦  Wars  like  WWII  (and  the  occupation  of  states  in  the  aftermath)  are  not  primary 
reference  for  modern  peacekeeping 

♦  Doctrine  for  assessment  will  aid  in  tool  development,  utility,  and  analyst 
preparation 

♦  We  need  a  model  to  prioritize  how  resources  are  spent 

♦  We  need  to  transition  from  measuring  completion  of  tasks,  to  achievement  of 
objectives  (effects  based  measurement) 

♦  Linear  combinations  of  output  metrics  can  be  subjective  and  mask  the 
importance  of  dependencies.  However,  the  analyst  may  not  have  the 
opportunity  to  present  complex  analysis 

♦  Influence  diagrams,  decision  analysis,  spread-sheet  tools,  GIS;  Microsoft 
Project  show  great  promise 

♦  Encourage  MORS  Sponsors  to  contact  the  various  agencies  to  find  out  what 
tools  and  requirements  they  have.  The  same  is  true  for  Coalition  members,  etc. 
the  US  military  is  not  the  only  organization  with  tools  that  can  support  Phase  IV 
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A  model  as  defined  here  is  a  mathematical  or  otherwise  logically  rigorous  representation 
of  a  system  or  a  system’s  behavior  -  in  this  case  combat  and  non-combat  operations.  A 
model  can  be  used  as  a  shorthand  form  of  communication  that  simplifies,  emulates,  or 
scales  some  aspect  of  the  real  system  in  order  to  enable  the  simulation.  The  difficulty  for 
analysts  is  how  to  select  optimal  simplifying  assumptions,  especially  when  improving 
upon  or  modifying  models  to  ensure  the  best  use  of  resources  and  to  prevent  the  models 
and  analysts  from  being  overwhelmed  by  the  amount  of  data  generated.  This  is  especially 
true  when  dealing  with  models  in  support  of  Phase  IV  operations 

WWII  is  not  a  relevant  model  for  Phase  IV  operations.  There  are  too  many  differences 
for  a  valid  comparison  with  today.  WWII  was  total  war  with  unconditional  surrender.  For 
example,  Dresden  Germany  was  totally  destroyed  by  allied  bombing.  In  fact,  the  amount 
of  war  damage  remaining  in  1991  was  greater  than  the  amount  of  war  damage  in  Baghdad 
in  2003.  One  out  of  every  seven  faces  in  post-War  Germany  was  an  Allied  face.  There  is 
no  way  that  the  United  States  has  the  ability  to  mobilize  and  put  this  many  boots  on  the 
ground. 

A  wide  range  of  models  exist  to  support  and  evaluate  Phase  IV  operations.  The  analytical 
requirements  of  Phase  IV  are  such  that  no  single  model  can  meet  all  of  them. 
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Models  and  Tools 


Tools  are  important,  but  not  essential  to  analysis.  The  analyst  himself  is  the  most  important 
tool.  Every  combat  analyst  is  an  analyst.  Every  analyst,  however,  cannot  be  a  combat 
analyst.  A  difficulty  we  have  is  that  in  general,  all  of  our  military  Services  are  deficient  in 
the  skills  required  for  Phase  IV  operations. 

Given  that,  the  selection  of  what  goes  into  the  analyst’s  tool  box  is  a  function  of  the 
analyst.  They  should  be  tools  the  analyst  knows  and  is  familiar  with.  During  a  deployment 
is  not  the  time  and  place  to  learn  new  tools.  Simplistic  tools  also  play  a  special  role  to  the 
analyst.  Not  only  do  simple  tools  allow  rapid  analysis,  critical  to  real-time  analysis,  but  the 
results  created  are  often  presented  in  a  more  appropriate  manner  to  an  information- 
saturated  combat  decision  maker. 

The  type  of  tools  required  also  depend  on  the  type  of  command  supported.  An  analyst 
supporting  a  division-level  command  will  require  different  tools  than  one  supporting  a 
theater-level  command.  Not  only  should  the  level  of  the  command  be  considered,  but  also 
who  within  the  command  an  analyst  is  supporting.  This  concept  is  also  true  with  respect  to 
the  different  services,  coalition  members,  and  the  IGO/NGO  community. 

Of  special  interest  are  spatial-analysis  tools.  Spatial  analysis  is  very  valuable  because 
commanders  already  understand  sophisticated  spatial  analysis  techniques  that  create  maps. 
Adding  thematic  data  that  represents  complex  analysis  is  only  one  step  beyond  what  the 
commanders  have  been  trained  to  understand  since  being  a  1st  lieutenant. 

Finally,  reach-back  capability  needs  to  be  fully  implemented.  Deployed  analysts  need  to 
understand  what  analytical  efforts  are  better  conducted  by  rear-area  organizations  with 
more  powerful  tools  at  their  disposal.  Tools  that  help  to  develop  or  facilitate  reach-back 
are  rapidly  becoming  available,  and  accessible  to  the  users. 
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General  Conclusions 


•  Conclusions 

♦  Deployed  analyst  is  an  ORSA  ambassador 

♦  There  is  a  profound  difference  between  how  the  military  and 
civilians  view  the  ends,  ways  and  means  and  the  metrics 
used  to  evaluate  them 

♦  Need  to  improve  communications  between  military  and 
civilian  analysts  and  organizations  (e.g.,  the  Iraqi  analytical 
huddles) 

♦  Reach-back  is  the  analysts  force  multiplier 

♦  Bureaucrats  are  a  good  thing... 


The  relationship  the  analyst  builds  with  the  decision  makers  is  decisive.  Analytical 
support  is  a  changing  environment.  It  is  also  determined  by  the  decision  maker  — 
and  not  all  decision  makers  are  the  same.  We  need  to  better  describe  what  we  can 
bring  to  the  table  for  the  other  elements  of  the  staff.  Deployed  analysts  are  of  great 
value  —  better  than  a  power-point  chart  in  explaining  to  the  staff  what  we  can  do. 

There  is  a  profound  difference  between  how  the  military  looks  at  analysis  and  how 
civilians  look  at  analysis.  The  culture  of  analysis  on  peace  operations  does  not  exist 
outside  of  the  military  as  it  does  within  the  military.  In  Iraq,  there  was  little  or  no 
communication  between  analysts  in  support  of  civilian  leadership  and  military 
leadership.  Most  of  the  analysis  was  done  on  the  military  side,  not  on  the  civilian 
side. 

There  is  a  difference  between  rebuilding  infrastructure  and  rebuilding  institutions. 
Rebuilding  infrastructure  is  constructing  schoolhouses.  Rebuilding  institutions  is 
providing  teachers,  a  curriculum,  equipment,  and  an  administration.  Rebuilding 
institutions  is  for  the  long  haul  and  involves  administration  and  the  personnel  cycle 
of  recruiting,  training,  and  developing.  The  numbers  of  administrators  required  is  a 
part  of  British  nation-building  doctrine.  Trained  bureaucrats  are  necessary  to  make  a 
country  function. 
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General  Recommendations 
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•  Recommendations 

♦  Further  develop  the  analyst 

■»  Management  of  data,  VBA,  and  the  presentation  of  information 

■»  Capture  experience  (5  w*s)  of  deployed  analyst  and  use  to  train  other 
analysts 

■»  Build  a  lessons  learned  web-site  for  deployed  analysts.  The  tools  and 
the  lessons  learned  (CALL,  AFSAA,  MORS,  JFCOM) 

Professional  school  curriculum  for  all  service  branches 

♦  Inform  senior  decision  makers  what  ORSA  analysts  can  bring  to  the  decision 
making  process  through  doctrine,  war  college,  other  means 

♦  Enhance  reach-back  capabilities  (joint,  inter-agency,  schoolhouses) 

♦  Coordinate  Phase  IV  analysis  efforts  between  commands,  services,  and 
agencies 

♦  Develop  proven  and  promising  tools  and  models 

♦  Improve  military-civilian  (IGO/NGO)  analytical  link-up 

♦  Need  to  further  develop  doctrine  for  assessment,  especially  Joint,  for 
analysis 

♦  Determine  what  analysis  can  be  made  available  to  the  rest  of  the  world  to 
encourage  IGO/NGO/PVO  analytical  efforts 


Recommendations  for  Future 
Workshops  and  Working  Group  Meetings 
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•  Further  discussion  on  analysis  support  to  operations  (not 
necessarily  a  Phase-specific  one) 

•  Work  directly  with  deployed  analysts  -  bring  the  conference  to 
the  theater 

•  Bring  in  international  contributors  (difficulty  with  classification) 

•  Bring  in  inter-governmental,  non-governmental,  and  private 
organizations 

•  Develop  courses  to  further  train  the  analyst 


There  are  several  general  recommendations  as  to  how  to  proceed  with  future 
workshops.  The  first  is  to  recognize  that  this  workshop  was  only  a  start. .  .or  more 
appropriately,  only  one  stop  on  the  path  to  analytical  nirvana.  The  success  here  in 
Newport  is  only  the  beginning.  After  three  days  of  work,  there  are  more  questions 
that  need  to  be  answered.  Thus,  the  first  recommendation  is  to  do  this  again.  The 
majority  of  individuals  would  attend  again,  perhaps  in  six  months,  to  determine 
what  has  been  accomplished. 

An  even  more  appropriate  recommendation  is  to  have  a  meeting  of  deployed 
analysts  discuss  this  issue. 

International  contribution  will  also  add  to  the  value  of  the  conference.  However,  it 
is  important  to  recognize  that  there  is  a  difficulty  in  the  fact  that  the  international 
members  cannot  have  access  to  classified  information.  Resolving  this  issue,  and 
obtaining  foreign  clearances  will  help  to  include  the  critical  international 
community  into  the  problem  analysis. 
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The  Global  War  on  Terrorism:  Analytical 
Support,  Tools,  and  Metrics  of 
Assessment 


Working  Group  3:  GWOT  Analysis  Resources 
(Tools,  Data,  People,  Methods) 


30  November  -  2  December  2004 
US  Naval  War  College 
Newport,  Rhode  Island 


Working  Group  3  was  charged  with  investigating  the  resources  needed  and 
available  for  analysis  in  the  Global  War  on  Terrorism  (GWOT).  The  group 
determined  that  these  resources  include  tools,  data,  people  (e.g.,  subject  matter 
experts),  and  methods. 
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Membership  included  US,  UK,  Israeli  and  Austrian  citizens  both  military  and 
civilians  with  varied  technical  expertise. 
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Process  -  General 
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•  Understand  terrorism  at  a  rudimentary  level 

•  Receive  presentation  on  several  “tools” 

♦  Simulations,  models,  decision  aids:  “named  things" 

♦  Methodologies:  potentially  useful  things 

♦  Resources:  databases,  people,  books? 

•  Meta-data  on  tools 

•  Develop  a  spreadsheet  of  tools  (w/meta-data) 

•  “Evaluate”  the  tools 

♦  From  the  Technologist’s  viewpoint 

♦  From  the  End  User’s  viewpoint 

•  Report  out 


The  first  order  of  business  was  to  reach  agreement  within  the  group  on  a  working 
definition  of  terrorism.  This  definition  was  used  to  ensure  a  common  basis  for  making 
decisions  on  the  various  aspects  of  the  group’s  program. 

The  tools  may  be  sophisticated  computer  programs,  such  as  simulations  or  linear 
programs;  they  may  be  simpler  computer  programs,  such  as  spreadsheets;  or  they  may  be 
non-computer  aids,  such  as  checklists.  The  data  may  reside  in  carefully  constructed 
databases  on  computers,  in  less  convenient  forms  on  computers,  or  as  hardcopy,  such  as 
books  and  papers.  The  word  “tools”  will  be  used  in  two  ways.  Its  broader  use  is  as  a 
simple  word  to  describe  the  various  resources  used  by  the  analyst  in  supporting  the 
GWOT.  “Tools”  in  its  narrower  sense  will  refer  to  simulations,  models,  and  decision 
aids  that  are  sufficiently  well-defined  to  have  been  given  names  by  their  developers. 

The  principal  function  of  the  group  was  to  produce  useful  information  about  the  tools  of 
GWOT.  Some  useful  things  can  be  said  about  tools  in  general;  however,  most  of  the 
value  will  be  in  listing  available  tools  and  information  about  those  tools  (meta-data)  and 
discussing  areas  that  are  missing  tools.  In  order  to  discover  that  something  is  missing, 
one  must  know  what  is  needed  and  what  is  available  that  might  fill  the  need  (the  list). 

The  actual  list  of  tools  with  the  metadata  is  included  as  an  Excel  spreadsheet  in  Appendix 
C. 

To  the  extent  possible,  the  group  also  added  an  evaluation  of  some  of  the  tools.  Working 
Group  3  divided  itself  into  two  subgroups  to  produce  such  an  evaluation.  One  subgroup 
considered  the  tools  from  a  technologist’s  point  of  view,  while  the  other  took  the 
viewpoint  of  possible  end  users. 

Finally,  the  group  produced  this  final  report. 
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Difficulty  in 
Defining  Terrorism 
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•  Is  Terrorism  a  tactic  or  a  clash  of  world  views? 

•  Do  we  need  to  know  why  terrorists  are  terrorists  from  a  “tool”  evaluation  point  of 
view? 

•  Clash  of  World  Views:  implies  a  need  for  careful  examination  of  culture(s)  of 
terrorists  for  clues  to  the  solutions 

•  Tactic:  implies  a  need  to  consider  whether  the  acceptance  of  the  tactic  is 
culture-specific  or  general  within  human  nature  and  how  that  acceptance  might 
spread  or  retreat 

•  These  two  points  imply  that  we  need  to  understand  the  social  landscape  of 
terrorism  to  ensure  that  the  correct  tools  exist  and  that  the  tools  perform  as 
needed 
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Difficulty  in  Il1©Jl3 
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Defining  a  Terrorism  Event 


•  By  Effect:  cultural  definition  (e.g.,  is  killing 
all  bugs  terrorism?  Was  fire  bombing 
Dresden  terrorism?) 

•  By  Intent:  cause  terror  (in  the  mind  of  the 
actor,  but  who  says,  e.g.,  hate  crimes  vs. 
crimes) 

•  By  Result:  cause  terror  (in  the  mind  of  the 
affected,  but  what  about  releasing  mice  in 
a  crowd?) 

•  When  is  a  freedom  fighter  a  terrorist? 


The  Ends  Justify  the  Means 

•  Rejected  in  Western  Thought 

♦  Actually,  reject  statement  that 
particular  ends  justify  any  and  all 
means 

♦  Most  agreed  that  removing  WMD 
from  Iraq  justified  invasion;  however, 
agreement  not  universal 

•  Terrorists  either 

♦  Believe  their  ends  justify  any  means, 
or 

♦  Believe  their  ends  justify  means  that 
we  don’t  agree  are  justified 


One  might  attempt  to  define  terrorism  by  its  effects,  by  its  intent,  or  by  its  results. 
However,  each  has  problems  when  taken  by  itself.  Killing  all  bugs  might  not  be 
terrorism  by  any  cultural  definition.  However,  killing  cows  in  India  certainly 
might  be  terrorism;  whereas,  killing  cows  in  the  US  would  not  be  automatically 
assumed  to  be  terrorism.  Defining  the  intent  of  a  perpetrator  is  difficult.  Even 
statements  by  the  perpetrator  may  be  insufficient  as  they  may  be  deliberately 
misleading  or  may  not  reflect  the  underlying  root  causes.  Even  though  terror 
may  be  the  result  of  an  act,  not  all  terror  is  caused  by  terrorism. 

The  fact  that  some  identify  individuals  as  freedom  fighters  and  some  others 
identify  the  same  individuals  as  terrorists  illustrates  that  the  definition  is  not 
straightforward. 

Perhaps  terrorism  has  a  philosophic  identity.  Most  of  the  Western  world  rejects 
the  philosophy  that  the  ends  justify  the  means,  or  rather  that  a  particular  goal  can 
justify  any  and  all  means  for  its  achievement.  Western  philosophy  contends  that 
the  means  for  achieving  a  particular  goal,  such  as  ensuring  that  Iraq  had  no 
weapons  of  mass  destruction  (WMD),  requires  debate  for  justification. 

Perhaps  it  is  a  fact  that  terrorists  either  believe  that  their  ends  justify  any  means 
or  that  their  ends  justify  means  that  the  rest  of  us  don’t  believe  are  justified  by 
those  ends. 

If  this  is  the  case,  then  naming  the  conflict  a  War  on  “Terrorism”  is 
appropriate,  because  we  are  objecting  to  the  tactics  (means)  being  used,  not 
their  right  to  desire  their  ends. 
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Anatomy  of  Terrorism 
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It  was  observed  that  terrorism  often  presents  itself  in  a  backward  sequence. 

First,  an  event  is  observed. 

Only  after  that  are  perpetrators  discovered,  said  perpetrators  having  motives, 
means  and  opportunity. 

After  that,  it  may  be  discovered  that  there  is  an  organization  behind  the 
perpetrators.  The  organization  having  its  own,  perhaps  different,  motives,  means 
and  opportunities. 

This  organization  may  instigate  additional  events  through  other  perpetrators. 

At  the  event  level,  the  “X”  marks  indicate  avenues  for  stopping  terrorism, 
through  preventing  a  particular  event,  capturing  or  killing  the  potential 
perpetrators,  or  removing  their  access  to  the  means  of  creating  the  event. 
Removing  all  the  opportunities,  “defending  against  attacks,”  is  “H”  or  hard. 
Removing  the  motive  sets  for  potential  perpetrators  is  a  long-term  effort,  “L”. 

At  the  organizational  level,  the  “X,”  “H,”  and  “L”  marks  have  the  same 
meanings. 
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Anatomy  of  Terrorism 
Sample  Characteristics 

•  Threat  or  use  of  violence  over  large  scales 

•  Political  goals 

•  Ideological  goals 

•  Unlawful  tactics 

•  May  have  legal  front 

•  Target  civilians  deliberately 

•  Non-state  organization 

•  State  terrorism 
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Several  characteristics  were  proposed  as  potential  determinants  for  the  existence 
of  terrorism. 

The  threat  or  use  of  violence  over  large  scales  is  meant  to  exclude  local  terrorism 
(e.g.,  the  Washington  snipers)  from  the  purview  of  the  Global  War  on  Terrorism. 

It  was  posited  that  from  an  organizational  perspective  political  and/or  ideological 
goals  should  be  present.  This  doesn’t  exclude  money,  excitement  or  adulation  as 
goals  of  some  of  the  individuals  involved. 

The  group  was  convinced  that  the  deliberate  and  consistent  use  of  unlawful 
tactics  must  be  involved. 

The  existence  of  legal  front  organizations,  political  or  charitable,  should  not 
exclude  organizations  as  terrorists.  Some  organizations  may  also  use  legitimate 
channels  in  such  a  fashion  as  to  bring  into  question  that  legitimacy,  e.g.,  the 
Hawala  money  transfer/banking  network,  or  national  policies  of  non-disclosure 
of  banking  information  , 

Conscious,  non-state  organizations  that  conduct  operations  are  candidates.  This 
does  not  exclude  collections  of  organizations  or  organizations  with  loosely 
connected  additional  individuals. 

State  supported  or  sponsored  organizations  are  possible  candidates;  however, 
there  was  disagreement  as  to  whether  organizations  that  act  solely  within  the 
sponsoring  state  could  be  labeled  as  terrorist. 
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Potential  Characteristics  vs 
Iconic  Groups 
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Characteristic 

A)  Qaeda 

Taliban 

Jamaah 

Islamiyah 

Hamas 

IRA 

US  Army 

Threat  or  use  of  violence  over  large 
scales 

0 

0 

0 

0 

0 

0 

Political  goals 

0 

0 

0 

0 

0 

0 

Ideological  goals 

0 

0 

0 

0 

0 

0 

Unlawful  tactics 

0 

13 

0 

0 

0 

m 

May  have  legal  front 

m 

0 

0 

0 

0 

0 

Target  civilians  deliberately 

0 

0 

0 

0 

0 

13 

Non-state  organization 

0 

13 

0 

0 

0 

13 

State  terrorism 

m 

0 

13 

13 

13 

13 

The  chart  above  shows  that  no  single  characteristic  is  sufficient  to  define  an 
organization  as  a  valid  target  for  the  Global  War  on  Terrorism.  However,  taken 
as  a  whole,  organizations  with  a  preponderance  of  check  marks,  especially  ones 
using  unlawful  tactics  and  targeting  civilians  deliberately,  are  targets. 
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15  Minute  Presentations  to  WG  3 
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•  Agent  Based  Modeling  for  Stability  and  Support  Operations  Analysis  Philip 
Barry,  Matthew  Koehler,  Brian  Widdowson 

•  Threat  Anticipation  Program  Agent-Based  Simulation  of  Terrorist 
Motivations,  Objectives  and  Strategies  (TAP AS)  Edward  MacKerrow 

•  Global  Terrorism:  Support  Tools  for  Prediction  and  Planning  Jim  Vaccaro 

•  Dynamic  Network  Analysis  for  Counter  Terrorism  Kathleen  M.  Carley 

•  Air  Operations  Center  (AOC)  Tools  to  support  GWOT  Strategy  Lawrence 
Spinetta 

•  Counter-Terrorism  Analysis  Capability  (CTAC)  Concept  Mike  McCurdy 

•  COAST,  etc.  Patrick  Allen 

•  FAST  Toolbox  for  OOTW  John  Cipparone 
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A  sample  of  metadata  entry. 
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MetaData  on  Tools 


Military  Operations  Research  Society 


MetaData  Item 


Examples 


•  Name 

•  POC 

•  Relevance 

•  Source 

•  Status 

•  Technique 


•  Time  Frame 
Soon,  Later 

•  Training  Time 

•  Type  Application 

•  Use  Issues 

•  Utlllty/Stmpllclty 

•  Validity 

•  WG  3  Assessment 

•  When  was  It  built 


(of  too!) 

(1-5) 

(company,  agency,  etc.) 

Available,  Prototype  -  Active,  Prototype 
-  Inactive,  Concept 
Automated  Cluster  Analysis,  Visual 
GIS,  Statistical  Analysis,  Network 
Analysis,  Forecasting,  Prediction, 
Situation  Awareness,  Fault  Tree, 
Decision  Tree,  Process  Control 
Results  are  applicable  Now,  Real 


Simulation,  Database,  Spreadsheet, 
Custom  Program,  Checklist 


d-5) 

(1-5) 


•  Which  questions  does  It  answer?  (focus  area(s)) 


"For  whom"  G2,  G3,  G5,  G7,  Commander, 

Ambassador,  FBI,  CIA 

Accreditation  What  type  of  network  can  this  tool  be 

displayed  on:  classified  or  unclassified 
Application  Area  Terrorists,  Events,  Instability,  Materials, 

Funding,  Support,  Plans,  Operations 
Category  Tool,  Method,  Data,  or  Person 

Comment 

Cost  (unit  cost,  program  cost) 

Customization  Time 
Description:  Use  Case 

Direct  User  OR  Analyst,  Intel  Analyst,  Detective, 

G3,  G5,  Trainer,  Troop,  Commander 
Does  it  handle  open  source? 

HW/SW  Requirements 
I/O  Format  (e.g.,  XML) 

Military  Use  Operations,  Crisis  Planning,  Training, 

Deliberate  Planning,  Analysis 


A  listing  of  metadata  categories  and  examples  of  entry  types 
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Initial  statistics  on  the  numbers  of  each  category  of  resources  in  the  spreadsheet. 
The  numbers  will  be  larger  in  the  final  spreadsheet. 
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Technologist  Subgroup:  14  Focus  Areas 
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ID  #  Questions 

•  1  How  can  we  predict  where  and  when  terrorists  will  attack? 

•  2  How  can  we  identify  terrorists? 

•  3  How  do  we  locate  and  model  terrorist  funds  and  funding  streams? 

•  4  How  do  we  locate  and  model  terrorist  resources  and  resource  streams? 

•  5  How  do  we  predict  the  effects  of  actions  taken  against  terrorists? 

•  6  How  do  we  engage  in  a  war  of  ideas  at  home  and  abroad? 

•  7  How  do  we  detect  and  counter  deception? 

•  8  How  do  we  support  planning,  execution  monitoring  and  assessment? 

•  9  How  do  we  support  creating  strategy  and  objectives? 

•  10  How  do  we  do  adversary  modeling? 

•  11  How  do  we  construct  a  social  network  of  parent  organizations? 

•  12  How  do  we  identify  individual  terrorists  to  kill? 

•  13  What  is  the  nature  of  GWOT? 

•  14  What  metrics  do  we  need  to  develop? 


The  fourteen  focus  areas  identified  by  the  Technologist  Subgroup. 


Technologist  Subgroup:  Process 

□  Mapped  OR  techniques  to  focus  areas 

♦  Identified  desired  capabilities  to  include  gaps 

♦  Did  not  explore  capabilities  not  used 

♦  Did  not  explore  how  terrorists  might  circumvent  our  approaches 

□  Refined  draft  GWOT  tool,  data,  and  decision  support  worksheet 

□  Future  Challenges  and  Observations 

♦  Need  Organization  to  coordinate  inter-agency  and  coalition  capabilities  (e.g.,  NSC  for 
US) 

■»  Lack  of  coordination  hurts  DoD  effectiveness 

■»  Lack  of  coordination  hurts  formulation  of  cohesive  National/Coalition  Strategy 
■»  Lack  of  coordination  enables  terrorists  to  circumvent  individual  agency  efforts 

♦  Need  to  transition  universities’  S&T  initiatives  directly  to  DoD  and  Intelligence  Agencies 

♦  Characteristics  of  classified  database  formats  and  data  limit  ability  to  develop  directly 
applicable  and  robust  tools 

a  Extent  of  Collaboration 

♦  DoD  facilitates  coordination  of  US  Services  and  Coalition  Forces 

■»  Potential  for  facilitating  USG  Interagency  coordination? 
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The  technologist  subgroup  began  by  defining  the  14  questions  of  the  previous 
slide.  They  then  mapped  techniques,  methodologies,  and  data  requirements  that 
were  appropriate  for  answering  each  question  (shown  on  the  next  set  of  slides). 

Using  this  mapping,  the  subgroup  entered  information  into  the  spreadsheet 
showing  which  focus  areas  (questions)  each  tool  might  address. 

Finally,  the  subgroup  listed  challenges  and  observations.  The  more  general 
comments  have  been  combined  in  the  fmal  recommendations.  The  ones  listed 
here  are  more  pertinent  to  tool  creation  and  use.  Coordination  and  collaboration 
are  prominent  needs. 
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1.  How  Can  We  Predict  Where  and 
When  Terrorists  Will  Attack? 
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List  of  Techniques  Needs  and  Data  Sources 

•  Intelligence  Community  tools  •  Intelligence  Community  databases 

•  Terrorists  Futures  Market 

•  Data  Mining  coupled  with  Markov  Models  for 
prediction 

•  Multiagent  systems  for  general  predictions 

•  Visualization  with  human  reasoning  to 
predict  patterns 

•  Simple  regression  analysis  on  existing  data 

•  Models  of  Red,  like  systems  dynamics 
models 

•  Massive  player  online  games  (Everquest) 

•  Wargaming 


Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 


Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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3.  How  Do  We  Locate  and  Model  111  ©3 3 
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Terrorist  Funds  and  Funding  Streams? 

List  of  Techniques 

Needs  and  Data  Sources 

•  Strategic 

•  Strategic 

♦  Mayaviz-virtual  simulated  dty 

♦  Data  sources  (Hawala,  charity  flows,  bank 

♦  Dynamic  network  and  network  flow  models 

transactons) 

♦  Link  analysis  tools 

♦  Security  Exchange  data 

♦  Multi-agent  modeling 

♦  Criminal  activity  to  support  terrorism  (smuggling, 

♦  Auditing  tools 

robbery,  narcotics) 

♦  Data  mining  toots 

•  Tactical 

♦  Explore  Dept  of  Treasury  /  ABA  techniques 

♦  Where  did  the  individual  get  funds? 

•  Tactical 

♦  How  much  money  is  the  individual  carrying? 

♦  Profiling 

♦  Link  Analysis 

♦  Data  commonality  Issues 

Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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5.  How  Do  We  Predict  the  Effects  of 
Actions  Taken  Against  Terrorists 
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List  of  Techniques 


Needs  and  Data  Sources 


Long  term  Effects  (5+  years) 

♦  COA  Analysis 

+  Wargaming  (Seminar,  structured) 

♦  Simulations  (multiagent,  other) 

♦  Planning  tools 

♦  Bayesian  Influence  Analysis 

♦  System  Dynamic  Models 

♦  Dynamic  Network  Analysis  Tools 

♦  ACTOR-like  models 

♦  Enterprise  Models  (Multi-regression  models) 

♦  Cultural  modeling 

Mid  Term  (1-5  years) 

♦  Real  gap  in  applying  techniques 

Near  Term  (<=  1  year) 

♦  COA  Analysis 

♦  Wargaming  (Seminar,  structured) 

♦  Simulations  (multiagent,  other) 

♦  Planning  tools 

♦  Bayesian  Influence  Analysis 

♦  System  Dynamic  Models 

♦  Dynamic  Network  Analysis  Toots 


Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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6.  How  Do  We  Engage  in  a  War  ofldeasHimS 
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at  Home  and  Abroad 


List  of  Techniques 


Planning  Tools 
Assessment  Tools 
Focus  Groups 
Cultural  Training  Tools 

Polling  and  market  research,  surveys,  diffusion 
models 

Social  Network  Analysis  {Identify  opinion  leaders) 
Meme  (e.g.,  Idea  battlespace/arena) 

Mental  Model  (what  they  say,  semantic  comparison, 
ontology) 

High  level  simulations 
Dynamic  Network  Analysis 
Support  to  PSYOP  {e.g.,  CNA) 

Techniques  to  encourage  popular  support  against 
terrorists 

Bayesian  Influence  techniques 
Webscraping  techniques 
Automated  and  seml-automated  text  analysis 
techniques 
»  Media  Analysis 
•  Language  translators 


Needs  and  Data  Sources 

•  Are  we  engaged  at  the  natlonal/globa!  level? 

•  Strategic  PSYOP  (Gap) 

•  Measuring  effect  of  PSYOP 

•  Massive  Data  storage  capabilities  required 


7.  How  Do  We  Detect  and  Counter 
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Deception? 

List  of  Techniques 

•  Data  Mining  Tools,  perturbation  analysis 

•  Linguistic  techniques  to  identify  excess 
pauses 

•  Polyscans,  brain  scans 

•  Wargaming,  brainstorming 

•  Structure  organization  to  avoid 
miscommunication  and  detect  deception 

•  Analyst  cueing  tool  (identify  non-redundant 
or  discrepant  information) 


Needs  and  Data  Sources 

•  How  do  we  identify  something  different  from 
the  norm 


m©35 


Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 


57 


8.  How  Do  We  Support  Planning , 

Execution  Monitoring  and  Assessment? 

List  of  Techniques  Needs  and  Data  Sources 

•  Classic  OR  Techniques 

•  Planning  tools 

•  Colored  Petri  Nets 

•  And  everything  above  and  below  as 
reachback  support 


rnsns 
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Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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9.  How  Do  We  Support  Creating 

Military  Operations  Research  Society 

Strategy  and  Objectives? 

List  of  Techniques  Needs  and  Data  Sources 

•  Wargaming 

•  Brainstorming 

•  SWOT  analysis  (strengths,  weaknesses, 
opportunities  and  threats) 

•  Influence  models 

•  Multiagent  modeling  (e.g.,  evolutionary 
models) 

•  Deliberate  analysis 


Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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10.  How  Do  We  Do  Adversary  mSR5 

Military  Operations  Research  Society 

Modeling? 

List  of  Techniques  Needs  and  Data  Sources 

•  Wargaming 

•  Brainstorming 

•  SWOT  analysis  (strengths,  weaknesses, 
opportunities  and  threats) 

•  Influence  models 

•  Multiagent  modeling  (e.g.,  social  network  and 
cultural  models) 

•  Bayesian  Net  Models 

•  Deliberate  analysis 

•  Rule  based  Red  reaction  models 

•  Red  Teaming 

•  Reinforcement  neural  net 

•  Colored  Petr!  Nets 


Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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11.  How  Do  We  Construct  a  Social  111^ 

ms 
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Network  of  Parent  Organizations? 

List  of  Techniques 

Needs  and  Data  Sources 

•  Strategic 

•  Strategic 

♦  Data  mining  of  raw  text  to  Identify  new  organizations  or  size 

♦  Identify  Region  of  Interest 

Of  organizations 

♦  Identify  the  Terrorist  Groups  In  Region  of  Interest 

♦  Network  Estimation 

♦  Databases  of  existing  terrorist  groups 

♦  Link  analysis  and  social  network  analysis 

♦  '  HUMINT/SIGiNT 

♦  Discriminant  analysis 

•  Operational 

•  Operational 

♦  Command  Structure  and  key  actors 

♦  Inferring  Resource  flows 

♦  Modus  operandi 

♦  Data  analysis,  link  analysis,  dynamic  network  analysis 

♦  Level  of  effort  or  sophistication 

♦  Simulation  of  network  perturbations 

♦  Known  resource  Flows 

♦  Wargaming 

•  Tactical 

•  Tactical 

♦  Terrorist  OPSEC  Tadics 

♦  Profiling  of  terrorists 

♦  Interagency  T  errorist  Lists 

♦  Target  Analysis 

♦  Access  to  real-time  raw  field  data 

♦  Friendly  OPSEC 

♦  Vulnerability/criticality  analysis 

♦  Forensic  Analysis 

♦  Terrorist  Flow  and  process  models 

♦  System  dynamics,  colored  Petri  nets,  multiagent  systems, 

♦  Influence  networks,  simulation 

Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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12.  How  Do  We  Identify  Individual  filSiRS 

MlUtary  Operations  Research  Society 

Terrorists  to  Kill?  (1) 

List  of  Techniques 

Needs  and  Data  Sources 

•  Strategic 

•  Strategic 

♦  Data  mining  of  raw  text  to  Identify  new  organizations  or  size 

♦  Identify  Region  of  Interest 

of  organizations 

♦  Identify  the  Terrorist  Groups  In  Region  of  Interest 

♦  Network  Estimation 

♦  Databases  of  existing  terrorist  groups 

♦  Link  analysis  and  social  network  analysis 

♦  HUMINT/SIGINT 

♦  Discriminant  analysis 

•  Operational 

•  Operational 

♦  Command  structure  and  key  actors 

♦  Inferring  Resource  flows 

♦  Modus  operandl 

♦  Data  analysis,  link  analysis,  dynamic  network  analysis 

♦  Level  of  effort  or  sophistication 

♦  Simulation  of  network  perturbations 

♦  Known  resource  flows 

♦  Wargaming 

•  Tactical 

•  Tactical 

♦  T enrorist  OPSEC  Tactics 

♦  Profiling  of  terrorists 

♦  Interagency  Terrorist  Lists 

♦  Target  Analysis 

♦  Friendly  OPSEC 

♦  Vulnerability  /  criticality  analysis 

♦  Forensic  Analysis 

♦  Terrorist  flow  and  process  models 

♦  System  dynamics,  colored  Petri  nets,  muttiagent  systems, 

♦  Influence  networks,  simulation 

♦  Access  to  real-time  raw  field  data 

Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 


62 


12.  How  Do  We  Identify  Individual  H1GR5 
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Terrorists  to  Kill?  (2) 

List  of  Techniques  Needs  and  Data  Sources 

•  Long  term  Effects  (5+  years) 

♦  COA  Analysis 

♦  Wargaming  (Seminar,  structured) 

♦  Simulations  (multiagent,  other) 

♦  Planning  tools 

♦  Bayesian  Influence  Analysis 

♦  System  Dynamic  Models 

♦  Dynamic  Network  Analysis  Tools 

♦  ACTOR-like  models 

♦  Enterprise  Models  (Multi-regression  models) 

♦  Cultural  modeling 

•  Mid  Term  (1-5  years) 

♦  Real  Gap  in  applying  techniques 

•  Near  Term  (<=  1  year) 

♦  COA  Analysis  ; 

♦  Wargaming  (Seminar,  structured) 

♦  Simulations  (multiagent,  other) 

♦  Planning  tools 

♦  Bayesian  Influence  Analysis 

♦  System  Dynamic  Models 

♦  Dynamic  Network  Analysis  Tools 


Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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13.  What  is  the  Nature  of  GWOT? 


Military  Operations  Research  Society 


List  of  Techniques  Needs  and  Data  Sources 

•  See  Working  Group  6  results  and 
introductory  notes  on  terrorism  and 
Insurgencies 


Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 
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Techniques  and  needs  or  data  sources  applicable  for  this  focus  area. 


65 


End  User  Subgroup:  Process 
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•  Purpose:  Evaluate  “tools  and  their  products”  for  “end 
use  and  implementation” 

•  Define  “users” 

•  Identify  “for  whom” 

•  Define  criteria  for  use  (Scale  1-5) 

♦  Relevance  (applicability  to  the  decision  or  question) 

♦  Utility/Simplicity  (ease  of  use  of  output) 

♦  Validity  (accuracy  for  intended  purpose) 


The  end  user  subgroup  had  the  problem  of  defining  who  the  end  users  might  be 
and  how  to  evaluate  tools  for  use. 

The  criteria  they  decided  upon  were  relevance  to  the  GWOT  problem  appropriate 
to  a  given  end  user,  the  utility  and  simplicity  for  the  end  user  of  the  tool’s  output 
(including  the  possibility  of  extensive  analyst  interface  between  the  actual  tool 
output  and  the  output  presented  to  the  end  user),  and  the  validity  of  the  results  for 
the  end  user’s  purposes. 
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End  User  Subgroup: 
Communicating  About  Tools 
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The  end  user  subgroup  spent  a  considerable  amount  of  time  trying  to  fit  the 
GWOT  problem  into  the  traditional  Strategic/Operational/Tactical  framework 
and  determined  that  this  framework  was  inappropriate.  They  determined  that  a 
multi-dimensional  framework  was  more  appropriate.  One  dimension  is  the 
functional  role  of  the  end  user.  A  second  dimension  is  the  physical  scale  of 
interest.  A  third  dimension  is  the  time  scale  of  interest.  Each  end  user  will  be 
concerned  with  a  specific  region  of  the  two  scales,  as  shown  by  the  colored/lined 
area  in  the  bottom  left  area  of  the  slide.  Each  tool  will  address  its  own  region,  as 
shown  in  the  upper  area,  marked  by  the  “x”s. 

Additionally,  each  user  will  be  interested  in  one  or  more  of  the  questions,  shown 
as  user  requirements  in  the  lower  right  of  the  slide.  In  this  example,  all  areas  are 
of  interest.  Each  tool  will  address  the  questions  with  different  levels  of 
competence.  In  this  example,  the  two  left  questions  are  shown  at  a 
yellow/vertical  lines  (moderate)  level;  the  middle  question  is  shown  at  the 
green/solid  (good)  level;  and  the  right  two  questions  are  shown  at  the 
red/horizontal  line  (poor)  level. 
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Recommendations,  etc . 

•  Data 

♦  Supremely  important  to  analysts:  Inputs  to  analysis 

♦  To  End  Users,  data  means  the  output  of  analysis 

•  Quality  of  Analyst 

♦  More  important  than  “tools” 

♦  Qualities  of  tools  is  an  easier  topic  to  discuss 

•  Infrastructure  easy  to  overlook 

♦  GIS,  general  visualization  tools,  collaborative  environment,  etc. 

♦  There  is  a  Terrorist  Watchlist  Group  that  has  proposed  standards  for 
icons,  which  may  be  useful  in  presenting  information 

♦  Things  that  reduce  data  management  time:  into  and  between  tools 
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Data  showed  an  interesting  dichotomy.  For  analysts,  data  is  supremely  important 
and  means  the  inputs  to  the  tools.  For  end  users,  the  analysts’  data  is 
unimportant;  however,  the  outputs  of  the  analysis  are  often  referred  to  as  data  and 
are  naturally  important. 

The  group  agreed  that  the  quality  of  the  analyst  is  more  important  than  the 
quality  of  the  tools.  A  good  analyst  can  produce  good  results  from  poor  tools; 
but  a  poor  analyst  is  unlikely  to  produce  good  results  even  with  good  tools. 
However,  the  quality  of  tools  is  easier  to  discuss. 

Infrastructure  tools  are  the  ones  that  support  the  process  of  analysis.  Tools  such 
as  geographical  information  systems  (GIS),  visualization  tools,  and  collaborative 
environments  can  be  invaluable  in  the  correct  settings  even  though  they  are  not 
GWOT  tools,  per  se.  Similarly,  tools  that  reduce  data  management  time  serve  to 
improve  the  analysis. 
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Recommendations ,  etc . 


Military  Operations  Research  Society 


•  Tool  qualities  vary 

♦  Time  to  use,  learn,  brief  results 

♦  Readiness  for  use,  manpower  to  operate 

♦  Robustness  in  face  of  limited  or  poor  data 

♦  Fractional  applicability  to  GWOT  (low  fraction  may  be  useful  when 
there  is  nothing  else) 

♦  “Force”  of  results:  hint,  suggestion,  “likely,”  “probable,”  firm,  “The 
Answer” 

•  Static  vs  Dynamic 

♦  Metrics 

♦  Tools 

♦  Rule  sets 


The  qualities  of  the  tools  are  varied.  Each  has  its  own  time  to  use,  leam,  brief 
results,  etc.  The  readiness  for  use  and  the  amount  of  manpower  required  to 
operate  the  tools  varies.  Some  are  more  robust  in  the  face  of  limited  or  poor  data 
and  others  require  complete  and  exact  data  to  produce  any  results  at  all. 

Two  other  qualities  are  important  to  understand.  Naturally,  tools  that  are  totally 
committed  to  GWOT  are  more  efficient  in  the  sense  that  effort  is  not  expended  to 
generate  only  small  amounts  of  applicable  output;  however,  a  tool  with  only 
fractional  applicability  can  be  useful  when  nothing  else  is  available.  In  addition, 
tools  vary  in  the  “force”  of  their  results.  A  tool  that  delivered  “The  Answer” 
would  be  wonderful,  although  very  unlikely.  However,  knowing  that  a  tool  only 
hints  at  a  result  can  be  very  useful  if  there  is  no  other  input  to  the  decision. 

Static  tools,  metrics,  rule  sets,  etc.,  can  be  useful;  however,  in  the  face  of  likely 
continual  change  in  the  GWOT  environment,  dynamic  tools,  metrics,  rule  sets, 
etc.,  may  be  more  useful. 


o^l  is 
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Recommendations ,  etc . 

•  No  too!  satisfies  all  needs  across: 

♦  Levels  of  command 

♦  Segments  of  problem  domain,  e.g.,  finding  terrorists,  reducing  spread  of  terrorism, 
preventing  resurgence 

♦  Reach-back  and/or  collaboration  may  be  frequently  needed 

•  Tool  Content 

♦  We  can  use  traditional  OR  techniques  (simulation,  regression,  etc.),  but  we  need 
some  new  specialized  ones 

♦  Major  gaps  in  current  tools  are  at  the  application  level  rather  than  at  the  general 
technique  level 

♦  Tools  should  be  assessed  and  continually  reassessed  against  reality 

•  Broader  Viewpoint 

♦  We  need  extensive  interagency  and  coalition  data  on  terrorism/terrorists 

♦  We  need  to  look  outside  the  military  at  other  communities,  such  as  banking, 
marketing  and  media,  for  ways  to  handle  human  factors 

♦  New  applications  should  be  developed  by  multidisciplinary  teams 


No  tool  was  discovered  that  satisfies  all  needs  in  any  dimension.  Combinations 
of  tools  and  collaboration/reachback  will  be  needed. 

Traditional  OR  tools  will  be  useful  for  GWOT;  however,  we  need  some  new 
ones,  also.  The  major  gaps  appear  to  be  at  the  application  level,  rather  than  at  the 
methodology  level. 

We  need  to  take  a  broader  viewpoint  in  GWOT  than  in  combat.  Other 
communities  are  involved  and  other  communities  can  help  with  analysis 
resources. 
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Recommendations ,  etc. 
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•  Applicability  of  the  strategic-operational-tactical  framework  to  GWOT  is 
in  question 


Finally,  the  applicability  of  the  strategic-operational-tactical  framework  in 
examining  the  needs  for  tools  was  not  helpful.  This  might  have  implications  for 
the  value  of  this  framework  in  the  broader  prosecution  of  the  GWOT. 
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The  Global  War  on  Terrorism:  Analytical 
Support,  Tools,  and  Metrics  of 
Assessment 


Working  Group  4:  GWOT  Metrics 


30  November  -  2  December  2004 
US  Naval  War  College 
Newport,  Rhode  Island 


Working  Group  4  Chairs  were  Dr.  John  Borsi  and  Lt  Col  Bob  Rosedale. 
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Introduction 
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•  Key  Focus  Area 

♦  JCS  J-5  GWOT  Strategic  Framework  Metrics 

■»  Existing  process  to  assess  progress  toward  SECDEF  GWOT  objectives 

•  State  of  the  Art 

♦  J-5  community  identified  issues  but  had  no  objective  metrics 

♦  Six  J-5  defined  Military  Strategic  Objectives 

•*  Proposed  MOE’s  for  each  MSO 

•  Good  Metrics:  What  are  you  really  trying  to  capture  -  Ends,  Ways,  or 
Means? 

♦  Ends  metrics  are  yardsticks  to  measure  progress  toward  or  away  from  a  stated 
objective 

♦  Ways  metrics  measure  level  of  activity  or  inputs  that  you  think  may  influence  the 
objective 

♦  Means  metrics  measure  resources  expended  to  support  the  ways 

♦  All  metrics  should  be 

•»  S  -  Specific 
M  -  Measurable 
A -Achievable 
R  -  Relevant 
■»  T  -  Timely 

MS— BBMBB— 


The  focus  of  the  working  group  changed  from  the  published  TOR  to  supporting 
J-5s  current  efforts  in  developing  the  National  Military  Strategic  Plan  for  the  War 
on  Terror.  The  NMSP-WOT  contains  a  hierarchy  of  leadership  objectives  and 
issues  on  which  the  SECDEF  would  like  to  measure  our  progress.  Prior  to  this 
workshop  the  existing  metrics  are  subjective  assessments. 

Our  challenge  was  to  identify  OBJECTIVE  measures. 

Recognizing  that  we  did  not  have  enough  time  here  to  accomplish  everything 
needed  to  define  good  metrics  we  did  try  to  keep  some  of  the  basics  in  mind  for 
the  development  of  good  measures. 
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Military  Strategic  Objectives  (MSO) 

•  Establish  conditions  that  counter  ideological  support 
for  terrorism 

•  Defeat  terrorists  and  their  organizations 

•  Deny  terrorists  the  resources  they  need  to  operate  and 
survive 

•  Enable  partner  nations  to  counter  terrorists 

•  Persuade,  coerce,  and  when  necessary,  compel  states 
and  non-states  to  cease  support  for  terrorists 

•  Deny  WMD/E  proliferation,  recover  and  eliminate 
uncontrolled  materials,  and  maintain  capacity  for 
consequence  management 


These  are  the  6  Military  Strategic  objectives  we  focused  on  to  develop  objective 
measures. 
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Example  Measures 

•  MSO:  Deny  WMD/E  Proliferation,  Recover  and  Eliminate  Uncontrolled 
Materials,  and  Maintain  Capacity  for  Consequence  Management 

♦  Issue:  Capacity  for  consequence  management 

♦  Metrics 

•*  Number  of  HAZMAT  teams 

•»  Timeliness,  accuracy,  relevancy,  and  coverage  of  notification  system 

-  Number  of  exercises/events  that  meet  established  standards 

Percent  of  response  times  that  meet  or  exceed  established  standards 
*  Number,  frequency,  and  scope  of  civil  HAZMAT  exercises  and  assessment 
Number  of  partner  nations  with  some  capability 

-  Resources 

-  Training 

-  Combined  exercises 

■»  Number  of  recovery  and  reconstitution  plans  for  critical  infrastructure 

-  Sourced? 

-  Exercised? 

■*  Readiness  ratings  for  identified  first  responders 


filSSS 
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This  is  an  example  of  some  of  the  objective  measures  we  developed.  For  this 
MSO,  one  of  the  identified  “issues”  was  maintaining  our  capacity  for 
consequence  management.  Looking  at  this  issue  we  developed  a  range  of 
proposed  metrics  to  track  over  time  that  range  from  the  relatively  mundane 
notion  of  the  number  of  hazmat  teams  we  have,  to  the  more  nebulous  issue  of 
timeliness,  accuracy,  relevancy  and  coverage  of  notification. 

This  last  issue  highlights  a  common  theme  through  many  of  the  metrics  we 
developed  that  we  need  to  have  established  “standards”  which  we  would  measure 
our  performance  against. 

In  addition,  measuring  capability  against  “rare  events”  will  probably  require  a 
full  complement  of  somewhat  realistic  exercises  to  test  that  capability. 


I 
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Work  to  be  Done 
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•  Refine  identified  measures  into  useful  metrics 

•  Identify  additional  metrics  required  to  fully  assess 
MSOs 

•  Establish  OPR/OCRs  (interagency  and  within  DoD) 

•  Identify  data  sources 

•  Partner  with  Civil  Affairs  and  Information  Operations  to 
develop  approaches  to  “winning  the  hearts  and  minds” 

♦  The  working  group  questioned  the  accuracy  of  “opinion  polls  and 
surveys”  as  sufficient  for  inclusion  as  metrics 


Our  experience  over  the  last  couple  of  days  fully  lived  up  to  our  expectations  that 
we  could  not  do  it  all.  Here  we  have  listed  most  of  the  activities  that  will  need  to 
be  done  to  make  our  efforts  more  useful. 

Of  particular  concern  is  the  need  to  establish  offices  of  primary  responsibility  and 
offices  of  collateral  responsibility  for  much  of  the  information  needed  for  these 
metrics.  The  current  approach  is  to  farm  all  of  the  measures  out  to  the 
COCOMS.  Many  of  the  defined  metrics  are  better  suited  to  agencies  outside  the 
DoD  or  for  central  collection  agency  such  as  DIA  or  the  Terrorist  Threat 
Integration  Center. 
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Unresolved  Issues 

•  MSOs  versus  military  activities 

♦  What  does  the  military  report  on?  How  do  we  report  at  the  strategic 
level  on  objectives  in  which  the  military  is  a  “supporting”  agency? 

■*  Example:  “Persuade,  coerce . states  ...  to  cease  support  for  terrorists” 

♦  WG  Recommendation: 

1 .  Assign  Global  metrics  to  central  agencies  and  collect  non-DoD  metrics  from 
responsible  agencies 

*  2.  Task  COCOMs  with  measures  of  military  activities  and  local/immediate 
impacts 

-»  3.  Correlate  military  activities  to  direct  MSO  metrics 

•  Available  resources  to  collect,  process,  and  score 
metrics 

•  Linkage  to  SECDEF  overarching  objectives 
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The  single  largest  point  of  contention  within  our  group  centered  on  whether  we 
should  be  reporting  on  the  level  and  effectiveness  of  military  activities  or 
whether  our  focus  should  be  on  metrics  that  are  often  outside  the  control  of  the 
DoD.  Recognizing  that  this  discussion  was  not  unique  to  this  workgroup,  we 
developed  a  compromise  position  that  we  recommend  on  this  slide  —  centered 
on  correlating  levels  of  military  activity  to  the  objective  measures  of  progress  for 
that  objective. 

Additionally,  we  need  to  note  that  we  are  talking  about  a  significant  level  of 
effort  required  to  go  from  “subjective”  assessments  to  “quantitative”  assessments. 
Realistically,  resources  will  need  to  be  allocated  toward  this  effort  if  the  DoD 
decides  to  implement  even  a  small  part  of  this  “quantification  effort.” 

Finally,  we  did  not  fully  do  what  we  set  out  to  do  —  we  still  need  to  link  these 
metrics  to  SECDEF  defined  overarching  objectives. 
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The  Global  War  on  Terrorism:  Analytical 
Support,  Tools,  and  Metrics  of 
Assessment 


Working  Group  5:  Decision  Support  to 
HLS/HLD 


30  November  -  2  December  2004 
US  Naval  War  College 
Newport,  Rhode  Island 


The  Working  Group  Chair  was  Tom  Denesia  from  NORAD-NORTHCOM 
Analysis  Directorate.  The  Co-Chairs  were  Glen  Roussos  and  Rich  Woodford 
both  from  NORAD-NORTHCOM  Analysis  Directorate. 
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Working  Group  5  was  formed  to  discuss 
pertinent  HLS/HLD  issues  and  focus  areas 
for  a  potential  workshop  in  the  November 
2005  timeframe. 
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Problem  Statement 
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Perceived  low  level  of  cooperation  among 
HLS/HLD  analytic  communities  contributes 
to  homeland  vulnerability. 


Even  though  some  interaction  takes  place  between  the  HLS  and  HLD 
communities,  it  appears  that  more  could  be  done  to  promote  coordination 
between  these  communities.  From  an  operations  research  perspective,  an 
interchange  between  the  communities  regarding  the  key  issues  and  resulting 
decision  support  tools  seems  to  be  needed.  For  example,  within  the  working 
group,  there  was  no  knowledge  of  any  DoD  analysts  working  with  DHS  analysts. 

There  seems  to  be  a  real  need  to  enhance  the  cooperation  and  there  appears  to  be 
no  forum  to  bring  analysts  together  to  bridge  analytic  issues  and  analysts  which 
support  FILS  and  HLD. 
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•  Establish  a  cooperative  analytic  framework 

•  Foster  analytic  cooperation  by 

♦  Providing  structure  for  a  recurring  forum 

♦  Developing  strategies  to  increase  cooperation 

♦  Addressing  analytic  disconnects  and  limitations 
Between  HLS  and  HLD  missions 
DoD  and  non-DoD  agencies 


The  analytic  community  needs  to  establish  a  structure  or  periodic  forum  where 
HLS  and  HLD  analysts  can  interact  and  exchange  information.  As  relationships 
are  established  between  the  analytic  communities,  information  can  be  exchanged 
more  freely  -  fostering  improved  cooperation. 

This  forum  could  identify  areas  where  analytic  efforts  overlap,  where  decision 
support  tools  exist  in  one  community  and  not  the  other,  and  where  there  is  a  lack 
of  decision  tools  in  either  community  for  key  issues  and  questions.  It  could  also 
identify  areas  where  the  unique  issues  of  HLS  and  HLD  have  no  overlap.  The 
result  would  be  a  synergistic  effort  where  overlapping  efforts  could  be  minimized 
and  existing  tools  developed  in  one  community  could  be  shared  with  the  other. 

The  cooperative  forum  would  primarily  focus  on  the  mission  aspect  of  each 
organization,  but  could  also  identify  the  agency  issues  associated  with  HLS  and 
HLD  analytic  cooperation. 
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Develop  common  HLS/HLD  analytical  support  for  the 
protection  of  the  US  through  the  identification  of 

♦  Critical  analytic  issues 

♦  Analytic  capabilities 

♦  Opportunities  for  cooperative  analysis 

♦  Assessment  techniques 

♦  Toolsets  and  models 

♦  Data  repositories  and  sources 

♦  Gaps  and  shortfalls 


The  workshop  purpose  is  to  identify  and  understand  common  areas  for  analytic 
support  to  decision  makers  in  both  the  HLS  and  HLD  analytic  communities. 

GWOT  Working  Group  5  identified  a  list  of  areas  that  each  proposed  working 
group  for  the  HLS-HLD  Workshop  should  address  and  provide  as  an  output  from 
the  workshop.  These  areas  include:  (1)  Critical  analytic  issues;  (2)  Analytic 
capabilities;  (3)  Opportunities  for  cooperative  analysis;  (4)  Assessment 
techniques;  (5)  Tool  sets  and  models;  (6)  Data  repositories  and  sources;  and,  (7) 
Gaps  and  shortfalls. 
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•  Maritime  Security 

•  T  ransportation 

•  Air  and  Missile  Defense 

•  Border  Security 

•  National  Infrastructure 

•  Consequence  Management 

•  Vulnerability  Assessment  -  Red  Team 

•  Scenario  Drivers 


The  working  group  discussed  potential  focus  areas/work  groups  and  which  organizations 
should  participate.  The  specific  focus  of  the  working  group  will  be  a  function  of  the 
specific  issues  and  who  will  end  up  chairing  the  group.  As  a  result,  our  working  group 
discussed  and  identified  potential  focus  areas,  potential  membership,  and,  in  some  cases, 
who  might  potentially  lead  the  working  groups.  These  focus  areas  include: 

Maritime  Security  should  incorporate  both  maritime  defense  and  maritime  domain 
awareness.  This  work  group  should  include  USCG,  DHS,  Navy,  BICE,  and  TSA. 

Transportation  should  include  maritime,  land  and  air.  This  WG  should  include  DOT,  FAA, 
USCG,  TSA,  rail  organization,  trucking,  and  Corp  of  Engineers. 

Air  and  Missile  Defense  should  focus  on  the  connections  that  are,  should  &  could  be  made 
with  DHS.  This  WG  should  include  DHS,  FAA,  FEMA,  JTAMDO,  MDA,  and  SMDC. 

Border  security  should  be  focused  on  the  land  borders  with  Canada  and  Mexico.  This  WG 
should  include  Canadians,  DHS/BICE,  border  patrol,  N-NC  BPG. 

National  Infrastructure  should  include:  DHS  and  the  National  Infrastructure  Protection 
Center  (or  whatever  it  is  called  now  under  DHS),  DTRA, ..) 

Consequence  Management  will  look  at  assets  and/or  resources  required  for  various 
events/issues.  This  WG  should  include:  DHS,  FEMA,  HHS,  CDC,  NGB,  USCG,  . . .) 

Vulnerability  Assessments  (via  Red  Teaming)  and  associated  scenarios  (Scenario  Drivers) 
should  be  addressed  prior  to  the  workshop  or  at  least  should  be  an  ongoing  activity  to 
periodically  review  and  re-assess  potential  vulnerabilities  and  the  resulting  changes  in 
scenarios  as  they  adapt  to  the  threat. 
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Working  Group  6:  Problem  Definition 


30  November  -  2  December  2004 
US  Naval  War  College 
Newport,  Rhode  Island 


Outline 
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•  Background 

•  Current  GWOT  Guidance 

•  WG  6  GWOT  Definition 

•  Historical  Comparison 

•  WG  6  Definition  Comments 

•  End-state 

•  Next  Steps  -  How  to  use  the  Definition 

•  Preliminary  Recommendations 


Background 
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•  WG  6  Composition 

♦  Only  one  intelligence  analyst/Islamic  specialist  on  the  first  day 

♦  Group  consisted  of  analysts  and  operators,  users  of  policy  guidance 

•  ...Beware  of  conclusions.".. 


WG  6  focused  on  the  GWOT  problem  definition.  Ideally,  this  group  should  have  been 
composed  of  Department  of  State  representatives,  Policy  staff,  counter-terrorism 
intelligence  experts,  operators/COCOM  staff,  and  ORSA  analysts. 

The  group  had  limited  regional  experience.  Only  one  member  (Mr.  Garry  Greco)  had 
served  on  the  Joint  Intelligence  Task  Force  for  Counter  Terrorism.  Although  Gary 
heavily  participated  during  the  formative  first  day  of  the  working  group,  he  was  not 
available  for  the  remainder  of  the  conference.  He  greatly  contributed  to  the  groups 
understanding  of  terrorists  associated  with  the  A1  Qaeda  movement  and  broader  groups  in 
North  Africa,  the  Middle  East,  Central  Asia,  and  South  East  Asia. 

The  group  was  heavily  weighted  toward  operators/COCOM  staff  (SOCOM,  EUCOM, 
PACOM,  Joint  Staff)  and  ORSA  analysts  from  throughout  the  Department. 

Thus,  the  perspective  of  this  brief  is  one  of  users  of  policy  guidance.  We  have  attempted 
to  frame  and  comment  upon  existing  guidance  and  open  literature  on  GWOT  from  an 
‘analytic  bent’  that  we  hope  will  be  of  assistance  to  our  leadership  and  for  future  analytic 
efforts. 
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•  Mr.  Andrew  Coe 

IDA 

•  Mr.  Michael  DeBarto 

SAIC 

•  LTC  David  Doane 

HQDA 

•  Mr,  Curt  Doescher 

Alton 

•  Dr.  Stephen  Downes-Martln 

NWC 

•  Mr.  Preston  Dunlap 

OSD  PA&E 

•  Mr.  Robert  Eberth 

Sanderllng  Research  Corp 

•  Mr.  Gary  Greco 

NWCIDIA  JITF(CT) 

•  MAJ  Jonathan  Hamill 

USAF 

•  Capt  Cheryl  Hetherington 

USAF 

•  MAJ  Dan  Leventry 

EUCOM 

•  Lt  Col  Peter  Livingston 

USAF 

•  Dr.  David  Markowitz 

OSD  PA&E  (Chair) 

•  Mr.  Scott  Mingledorff 

NGIC 

•  Mr.  Michael  Ottenberg 

AT&T 

•  LTC  Burdett  Thompson 

Joint  Staff  J-5 

•  COL  Glenn  Vavra 

SOCOM 

•  Dr.  Robert  Westerman 

PACOM 

•  Mr.  James  Bexfleld,  FS 

OSD  PA&E  (Synthesis  Group) 

•  Dr.  Gregory  Parnell,  FS 

USMA  (Synthesis  Group) 
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Although  the  definition  of  definition  is  elementary,  a  descriptor  of  the  nature  of  the 
GWOT  conflict  is  particularly  important  for  analysts  without  large  exposure  to  high-level 
policy  debate  on  the  GWOT  strategy,  objectives,  and  goals.  Without  it,  analysts  will 
wander.  As  of  the  time  of  this  MORS  Workshop,  only  a  limited  number  involved  with 
GWOT  contingency  plan  development  have  been  exposed  to  this  information. 
Unfortunately,  this  work  is  still  in  draft  and  may  not  be  released  to  a  wider  audience. 
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Current  GWOT  Guidance 

•  Definition  from  current  strategy  documents 

♦  Three  objectives  for  GWOT 

Defend  the  homeland 
Defeat  terrorist  networks 
Win  the  war  of  ideas 

♦  Enemy  is  a  ‘network  of  networks’  composed  of  extremists 

•  Problem:  current  GWOT  guidance 

♦  Does  not  describe  the  nature  of  the  conflict 

■»  It  Focuses  on  the  tactic  employed  (terrorism)  which  leads  to  a  failure  to 
appreciate  the  nature  of  the  conflict 
-»  A  “network  of  network”  describes  all  human  activities 
Is  too  easily  confused  with  targeting 

♦  Is  too  nebulous  to  operationalize  -  what  is  the  war  of  ideas? 

♦  Does  not  acknowledge  potential  long  duration  of  the  conflict 
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There  are  several  published  and  draft  GWOT  guidance  documents.  The  important  guidance 
documents  include  the  “National  Strategy  for  Combating  Terrorism”  developed  by  the  National 
Security  Council,  the  Department  of  State  Regional  Action  Plans,  and  the  draft  National  Military 
Strategic  Plan  for  the  War  on  Terror.  The  9/1 1  Commission  report,  although  not  a  policy 
document,  also  provides  valuable  insights  on  the  nature  of  the  conflict. 

The  existing  guidance  documents  and  the  9/1 1  commission  are  self-consistent  on  the  overall 
objectives  for  the  GWOT.  These  are  summarized  under  the  first  bullet. 

However,  the  guidance  is  vague  on  the  nature  of  the  conflict.  Chapter  12  of  the  9/1 1  Commission 
is  very  direct  in  its  criticism  of  the  policy  for  its  lack  of  clarity.  The  title  ‘Global  War  on  Terror’ 
is  not  analytically  productive  in  that  terrorism  is  a  tactic  to  achieve  an  ends.  Beyond  a  criminal 
organization,  it  does  not  describe  the  threat  or  source  of  conflict  —  a  people  with  a  political 
objective. 

Within  the  Department,  the  published  descriptive  terms  meant  to  convey  further  meaning,  such  as 
a  ‘network  of  networks’,  are  not  particularly  useful.  A  network  can  describe  any  sort  of  human 
activity.  For  example,  working  group  6  is  a  network.  At  the  next  level,  this  MORS  conference  is 
a  network  of  networks.  Unfortunately  in  the  Department  of  Defense,  the  term  ‘network’  has  been 
utilized  in  a  variety  of  contexts  with  connotations  potentially  inappropriate  for  GWOT  —  It 
describes  a  communications  system,  a  new  form  of  high-tech,  ‘transformed’  ‘net-centered’ 
warfare  only  available  to  the  US,  and  a  method  used  for  targeting.  All  but  the  last  are  confusing 
when  describing  the  A1  Qaeda  movement  and  the  last  leads  one  to  focus  on  killing  -  not  the  larger 
war  of  ideas. 

Additionally,  none  of  the  documents  specify  the  tenets  for  the  war  of  ideas.  What  are  ours  and 
what  are  theirs?  Again,  terrorism  is  a  tactic,  not  a  people,  movement,  or  objective. 

Lastly,  all  parties  studying  GWOT  generally  agree  that  the  global  conflict  that  resulted  in  the  9/1 1 
attacks  will  last  for  an  extended  period.  Although  the  term  ‘Global  War  on  Terror’  has  strong 
political  motivation,  the  war  of  ideas  may  necessitate  preparing  the  American  people  for  a 
conflict  potentially  lasting  decades. 


WG  6  GWOT Definition 
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Problem  statement 

♦  The  world  is  confronted  with  an  Insurgency  within  Islam  of  global  scope 

Challenge 

♦  De-leoltlmlze  the  insurgency 

♦  Support  the  Muslim  community  in  developing  viable  alternatives  to  the  insurgency 

♦  The  US  will  need  a  global  strategy,  yet  need  to  be  locally  flexible  at  the  operational  and  tactical 
levels 

Complications 

♦  The  conflict  does  not  appear  to  have  any  bounds,  if  there  are  any,  they  will  be  determined  by  the 
Muslim  population 

The  insurgency  appears  to  have  expansive,  nonnegotiable  political  aims 
WMD  and  other  technologies  have  changed  the  calculus  of  fringe-element  insurgents 

♦  Insurgent  area  of  operations  has  expanded  to  include  the  United  States,  Europe,  and  the  rest  of  the 
non-lslamic  world 

Center  of  Gravity 

♦  Population  (both  theirs  and  ours) 

Better  Means: 

♦  Support  the  locals  to  win  the  war  for  themselves 


♦ 

♦ 


Definition  consistent  with: 

•  Defend  the  homeland 

•  Defeat  terrorist  networks 

•  Win  the  war  of  ideas 
Nature  and  Focus  are  different 


Although  controversial  and  politically  sensitive,  the  term  ‘insurgency  within  Islam’  is  highly  descriptive  of 
the  nature  of  the  conflict.  It  provides  focus  on  the  threat,  their  approach,  their  objectives,  and  a  framework 
for  examining  US  and  community  response.  Terrorism  is  a  tactic  of  an  insurgent.  It  is  also  important  to  note 
that  this  is  not  a  ‘war  against  Islam’.  This  is  a  conflict  amongst  the  Muslim  community.  A1  Qaeda  is  seeking 
to  change  the  system  of  governance  in  the  Muslim  world.  Ultimately,  it  will  be  the  Muslim  community’s 
decision  to  accept  A1  Qaeda’s  vision,  continue  with  their  current  regimes,  or  find  an  alternative. 

This  working  group’s  adoption  of  an  insurgency  framework,  however,  is  not  meant  to  suggest  a  disregard  for 
the  growth  of  transnational  threats  or  other  ‘terrorist’  organizations.  Currently,  there  is  no  other  global 
terrorist  network  beyond  Islamic  extremists.  This  is  the  greatest  threat. 

Multiple  views  support  an  insurgent  framework,  including  the  9/1 1  Commission  and  Gen  Downing’s  talk  at 
this  MORS  workshop.  It  is  interesting  to  note  that  Gen  Downing  participated  in  the  2002  drafting  of  the 
National  Strategy  for  Combating  Terrorism  and  has  currently  presented  an  insurgency  point  of  view. 

The  challenges  listed  on  the  slide  are  natural  consequences  of  an  insurgency  framework.  Core  to  winning  an 
insurgency  is  establishing  the  legitimacy  of  one’s  side  and  de-legitimizing  the  other.  Like  all  politics, 
insurgencies  are  local  in  nature.  Motivation  can  be  global,  but  they  are  decided  locally. 

The  complications  represent  unique  features  for  this  insurgency  not  seen  in  other  historical  examples.  The 
combination  of  the  four  points  creates  a  direct  security  concern  for  the  United  States  and  changes  US  risk 
calculus  for  becoming  involved  with  the  conflict. 

The  center  of  gravity  falls  naturally  from  the  insurgency  framework.  It  is  one  of  the  few  common  threads 
among  the  wide-range  of  historic  insurgencies. 

The  means  for  success  are  only  indirectly  related  to  US  actions,  the  best  means  is  for  the  locals  need  to  win 
for  themselves. 

As  noted  on  the  bottom  right  of  the  slide,  the  insurgency  framework  fully  supports  the  three  strategy 
objectives  identified  on  the  previous  slide.  The  framework  suggests  mechanisms  to  achieve  them  - 
mechanisms  the  ORSA  community  can  assess  and  improve. 
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Comparison  between  Communist  Motivated  Wars  of 
Liberation  and  GWOT/Islamic  Insurgency 

•  Similarities  •  Differences 


Politically  motivated  and  ideologically 
justified  (communism/Islam)  -  neither  are 

♦ 

Growing  nonstate-sponsorship  of 
insurgencies 

monolithic 

Myth  and  glorification  of  insurgency 

♦ 

No  extemal/state-imposed  limits  on 
actions 

War  by  indirect  means  (proxy) 

♦ 

Global  reach/battlefield 

Center  of  gravity:  people 

♦ 

WMD  proliferation  to  third  world  insurgents 

Long  term  war  -  decades 

♦ 

Fragmented  and/or  incomplete  US 
strategy  on 

•»  Strategic  communication 

■»  Alliance  structure 

■>  US  government  organization 

♦  Communism  had  more  clearly  defined 
sponsor  -  current  situation  is  more  like 
1880s 

♦  Religious  vs  economic  motivation 


The  insurgency  framework  is  further  explained  by  a  historical  comparison.  This  slide  provides  examples  of 
the  similarities  and  differences  between  the  wars  of  liberation  experienced  during  the  early  stages  of  the  cold 
war  and  today’s  insurgency  within  Islam. 

Some  highlights  to  note  on  the  slide: 

-Similarities,  2nd  bullet:  The  resistance  movements  of  World  War  II  were  perceived  by  the  participants 
as  decisive  methods  for  wining  the  conflict.  Both  sides  propagated  myths  of  their  success  (French 
resistance  in  western  Europe,  partisan  resistance  in  Eastern  Europe,  communist  resistance  in  China)  and 
this  became  the  inspiration  for  many  of  the  wars  of  liberation  started  in  the  late  40s,  50s  and  early  60s. 
Noteworthy  early  successes  of  these  movements  furthered  the  perception.  Similarly,  the  Soviet 
withdrawal  from  Afghanistan  inspires  the  A1  Qaeda  movement.  The  myths  associated  with  the  late 
1980s  motivate  many  of  their  actions  with  the  hope  that  they  may  replicate  that  conflict  on  a  greater 
scale. 

-Differences,  first  four  bullets:  One  of  the  primary  changes  from  the  cold  war  era  is  the  growth  of  non¬ 
state  sponsored  insurgents.  Many  are  empowered  by  the  ease  of  obtaining  disruptive  technology.  This 
has  several  implications.  The  lack  of  a  state  removes  traditional  interstate  escalation  control.  The  ease 
of  movement  of  non-state  actors  has  expanded  the  battlefield  globally.  Unlike  the  cold  war  where  only 
the  super-powers  were  able  to  possess  WMD,  the  spread  of  technology,  in  particular  bio-technology,  is 
available  through  small,  individually  funded  organizations. 

-Differences,  5th  bullet:  Another  significant  change  is  the  underdeveloped  USG  response  to  the  GWOT. 
The  USG  initiated  a  far  sweeping  series  of  alliances,  internal  reforms,  and  strategic  initiatives  to 
confront  Communism  and  Soviet  expansion  to  include  the  proxy  wars  of  the  era.  To  date,  the  US  is  still 
formulating  its  GWOT  response.  Although  the  US  has  created  the  Department  of  Homeland  Security 
and  produced  several  national  strategy  documents,  the  overall  vision  of  how  to  wage  the  war  on  terror 
has  not  been  absorbed  by  a  large  set  of  the  Department.  For  example,  at  this  working  group  only  a 
handful  of  people  understood  that  the  Department  of  State  was  the  lead  organization  for  the  GWOT. 
This  lack  of  common  vision  in  the  staff  hinders  our  ability  to  wage  the  strategic  communication  war, 
hinders  our  ability  to  participate  in  an  alliance  structure,  or  the  inter-agency. 


92 


WG  6  Definition  Comments 


mms 

Military  Operations  Research  Society 


•  Insurgency  framework 

♦  Significant  literature  and  background  on  insurgencies 

♦  Good  classification  and  analytic  techniques  appear  available 

♦  Tools  may  not  be  advanced 

•  Challenges  and  gaps 

♦  How  should  the  USG  and  international  community  structure  itself  to  confront 
the  insurgency  within  Islam? 

♦  How  do  we  win  the  war  of  ideas? 

What  do  Muslims  want  for  a  legitimate  government? 

How  do  we  de-legitimize  the  Islamic  extremists? 

♦  How  does  the  US  influence  a  society  where  the  US  is  not  wanted? 

♦  Can  we  set  boundaries  or  limits  to  the  violence? 

♦  How  to  set  US  public  expectations  for  a  long,  violent  war? 


The  last  two  slides  provide  a  description  of  the  problem.  The  insurgency  framework  has 
several  benefits  in  focusing  the  analytic  community  on  how  to  address  GWOT  issues. 
These  benefits  are  listed  under  the  first  bullet,  with  a  warning  that  more  in-depth  tools  the 
ORSA  community  has  relied  on  in  the  past  may  need  to  be  developed  for  this  new 
conflict. 

The  second  major  bullet  highlights  some  major  challenges  we  need  to  resolve  to  confront 
the  insurgency  within  Islam.  They  are  derived  from  the  insurgency  framework.  These 
serve  as  an  initial  set  to  motivate  the  ORSA  (and  broader)  community  to  develop  analytic 
assessments  and  methods  to  support  our  senior  leadership. 
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•  Muslim  population  has  rejected  and  acts  against  any 
resurgent  Islamic  insurgency 

•  Attacks  on  the  United  States  and  its  allies  have  been 
eliminated  or  are  limited  to  an  acceptable  level 

•  Muslim  nations  peacefully  integrate  into  the  world 
economy 


This  slide  provides  a  list  of  proposed  end-state  conditions  as  derived  from  an  insurgency 
point  of  view. 

The  first  end-state  reinforces  the  second.  The  second  is  not  achievable  without  the  first. 

The  third  bullet  refers  to  the  overall  goal  of  integrating  the  Muslim-developed  viable 
‘alternative’  within  the  global  economy  so  that  the  flow  of  strategic  resources  will  be 
maintained. 


Military  Operations  Research  Society 


Next  Steps  -  How  to  use  the  Definition 

•  Analytic  Agenda:  Defense  Planning  Scenario  on  GWOT 

♦  Challenge:  inter-relationship  between  Green  (the  people)  and  Red  (Islamic 
insurgents  and  sympathizers) 

♦  Uses  of  the  scenario 

•»  Strategic  discussions  in  QDR 

■»  Explore  re-organization  of  USG 

•»  CONOPs  testing  and  development 

■*  Test  and  evaluate  a  2012  STRATCOM  10  portfolio 

■»  Identify  TEMPO'  of  mission-areas  for  GWOT  (how  frequently,  how  long) 

•  Initial  thoughts  on  analysis  and  modeling 

♦  Traditional  mission  models  for  DoD  activities  associated  with  GWOT  may  be 
adequate 

♦  Insurgency  campaign  modeling  is  of  concern 


The  working  group  discussed  how  the  community  might  use  this  definition. 

The  first  step  was  to  incorporate  our  findings  into  the  Analytic  Agenda.  The  Analytic 
Agenda  is  a  Department-wide  initiative  to  improve  the  quality,  transparency,  and  speed 
of  analysis  to  support  the  Department’s  decision  processes.  One  of  the  pillars  is  the 
development  of  a  scenario  set  that  will  be  commonly  used  by  the  Components  to  inform 
resourcing  decisions.  The  Defense  Planning  Scenarios  (DPS),  published  by 
OSD(Policy),  are  the  the  first  step.  They  provide  high  level  guidance  on  scenario  scope, 
participants,  road  to  war,  Blue  and  Red  CONOPs,  and  a  range  of  variables  the 
community  should  explore.  Select  DPSs  are  then  followed  by  the  development  of  more 
in-depth  force  and  CONOPs  data  sets  (Multi-Service  Force  Deployment  data),  and 
‘analytic  baselines’  -  initial  analytic  assessment  with  all  of  the  information  required  to 
provide  that  assessment. 

Currently,  a  GWOT  scenario  is  under  discussion.  If  an  insurgency  framework  is  used  in 
such  a  scenario,  the  DPS  will  need  to  expand  on  the  center  of  gravity:  the  people.  This 
type  of  information  has  not  been  included  in  the  scenarios  to  date. 

The  second  sub-bullet  lists  potential  users  of  the  DPS  scenario.  The  working  group  then 
discussed  methods  to  assess  such  a  DPS.  Overall,  the  community  felt  comfortable  that 
mission-level  models  could  be  modified  or  jury-rigged  to  provide  some  level  of 
assessment.  The  greatest  challenge  would  be  to  link  the  missions  together  into  an  overall 
campaign  plan.  Many  of  the  tools,  and  plain  know-how,  will  need  to  be  developed. 
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Preliminary  Recommendations 

•  Examine  US  National  Security  Structure 

♦  What  is  the  US  structure  to  balance  winning  the  war  of  ideas  and  killing  terrorists  through  military 
action? 

♦  Immediate  goal  of  sharing  data/creation  of  a  common  data  system  among  allies,  agencies,  and 
departments 

•  Understand  the  Muslim  Community 

♦  Understand  and  utilize  the  Muslim  diaspora 

♦  Increase  leadership  exchanges  -  this  includes  US  going  abroad  to  Muslim  countries 

♦  Obtain  a  better  understanding  of  Muslim  cultural  boundaries  and  how  to  shape  them 

«  Wage  the  war  of  ideas 

♦  What  is  an  alternative  to  Bin  Laden  in  the  eyes  of  Muslims? 

♦  Examine  Islamic  de-programming  techniques 

•  Educate  the  American  public  on 

♦  The  nature  of  the  conflict 

♦  The  potential  length  of  the  conflict 

•  Define  DoD  Roles  and  Missions 

♦  Explore  how  the  military  can  be  effectively  used  across  a  broad  range  of  missions  to 
address  the  conflict  (e.g.  assistance  and  security,  El  Salvador) 


This  slide  summarizes  the  working  group’s  recommendations  to  further  progress  in 
assessing  the  GWOT  from  an  insurgency  framework.  They  are  listed  roughly  in  priority, 
with  the  first  bullet  being  the  highest,  the  2nd  through  4th  being  the  next  tier,  and  the  5th 
is  the  last. 

The  first  has  the  highest  priority  because  it  will  establish  who  is  responsible  for 
conducting  the  remainder  of  the  tasks.  The  second  tier  (bullets  two  through  four)  are 
crucial  for  winning  the  war  of  ideas  and  seizing  the  conflicts  center  of  gravity:  the  people. 
The  last  is  of  importance  to  the  Department. 
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The  Global  War  on  Terrorism:  Analytical 
Support,  Tools,  and  Metrics  of 
Assessment 


Synthesis  Working  Group 

30  November  -  2  December  2004 
US  Naval  War  College 
Newport,  Rhode  Island 


Co-Chairs: 

Col  Jerry  Diaz  and 
Dr  Greg  Parnell,  FS 
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The  Synthesis  Working  Group  (SWG)  is  a  strategic  body 
that  helps  the  workshop  achieve  its  objectives  by 

•  Synthesizing  the  products  of  the  six  working  groups  by 

♦  Determining  common  themes 

♦  Highlighting  the  seams  or  gaps 

♦  Identifying  critical  issues 

•  Facilitating  as  necessary 

•  Developing  overarching  workshop  recommendations 


■B— B— 


A  MORS  workshop  is  fundamentally  different  than  the  MORS  Symposium  or  a 
mini-symposium.  In  a  symposium  setting,  you  sit  back  and  receive  presentations 
about  the  work  that  colleagues  are  pursuing.  In  a  workshop,  you  are  expected  to 
participate  in  the  discussion.  Your  working  group  lead  should  schedule  at  least 
as  much  time  for  discussion  as  there  is  for  presentations.  The  output  is  more  than 
knowledge  gained,  but  a  product  distinct  to  that  working  group’s  goals. 

The  goal  of  the  GWOT  workshop  was  to  provide  a  forum  for  discussing  analytic 
support,  tools,  metrics,  and  to  gain  insight  on  operational  assessment  techniques 
and  capabilities  to  better  support  the  GWOT.  The  objective  of  the  SWG  is  to 
help  the  Workshop  Chair  achieve  his  goals  for  a  successful  meeting.  We  asked 
the  Synthesis  members  to  identify  three  things: 

1 .  Themes  that  are  common  to  other  working  groups 

2.  Gaps  or  seams  that  the  working  groups  or  the  workshop  is  missing 

3.  Critical  issues  that  may  be  unique  to  that  working  group,  but  need  to  be 
reinforced  to  the  entire  workshop 

Also,  we  helped  the  working  group  leads  by  facilitating  as  necessary  and  as  a 
group,  developed  overarching  workshop  recommendations. 
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WG-1 

Forecasting 

Instability 

Gene  Visco.  FS  X 

Grea  Parnell,  FS 

WG-2 

Analytic  Supp 
to  Stab  Ops 

WG-3 

Tools  to  Supp 
GWOT 

WG-4 

Assess  Mil 

Effec  in  GWOT 

WG-5 

HLD/HLS 
Workshop  Def 

WG-6 

GWOT 

Prob  Def 

X 

Mike  Neiahbour 

X 

Mike  Garrambone 

X 

Dick  Deckro 

X 

Don  Duncan 

X 

Dave  Davis 

X 

Jim  Bexfield.  FS 

X 

Jerrv  Diaz 

X 

We  had  nine  members  on  the  Synthesis  group  —  a  group  of  very  senior,  eclectic, 
MORS’ians  to  be  sure.  Some  of  our  members  sat  in  one  working  group,  others 
floated  amongst  groups. 
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GWOT  presents  a  tremendous  challenge: 

•  The  world  is  confronted  with  an  insurgency  within  Islam 

•  Operations  primarily  against  globalization  of  western 
values  and  influence 

•  Leverage  network  of  extremists  that  export  terrorism 
locally,  regionally,  and  globally 

•  WMD  significantly  magnifies  risk 


We  had  some  general  observations  about  the  workshop.  The  Global  War  on 
Terror  presents  us  with  tremendous  challenges: 

-We  are  confronted  with  an  insurgency  within  Islam.  We  recognize  that  our 
fight  is  not  against  the  Islamic  Religion,  but  with  extremists  within  Islam. 
Further,  although  we  make  the  point  that  our  fight  is  not  against  Islam,  we 
then  use  words  that  make  it  sound  like  it  is. 

-The  enemy  conducts  operations  against  the  globalization  of  western  values 
and  influence. 

-The  threat  is  not  hierarchical  in  nature.  It  is  a  collection  of  loosely  networked 
cells  that  act  independent  of  each  other  and  any  chain  of  command. 

-Further,  weapons  of  mass  destruction,  i.e.  technology,  magnify  the  risk  to 
our  populace  and  way  of  life. 
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SWG  Observations 

•  GWOT  is  difficult  because  of  its  breadth 

♦  Need  to  assess  effectiveness  of  specific  operations,  but  to  evaluate  globally 

♦  Cannot  afford  to  win  the  battle,  but  lose  the  war  or  the  peace 

•  Need  to  define  the  end  state 

♦  US/Allies  globally,  regionally,  locally 

♦  Timeline:  War  of  Generations 

♦  Identify  milestones  to  get  there?  Metrics? 

•  Documents  that  lay  an  initial  framework  for  GWOT 

♦  National  Strategy  for  Combating  Terrorism 

♦  National  Military  Strategic  Plan  for  the  WOT  (DRAFT) 

♦  US  Government  Action  Plan  for  the  War  on  Terror 

♦  OPLAN  71  -  Identifies  SOCOM  as  the  military  lead  for  GWOT 


The  Global  War  on  Terror  is  difficult  to  assess  because  of  its  breadth.  It  is  far 
easier  for  us  to  assess  the  impact  of  a  particular  operation  than  to  determine  its 
impact  on  this  global  war.  We  need  to  think  globally. 

We  need  to  be  able  to  determine  the  impact  of  yesterday’s  battle  in  Faluja  on 
tomorrow’s  fight  in  Indonesia.  Where  is  the  analyses  to  determine  this?  Who  is 
thinking  globally?  Where  is  the  organization,  tiger  team,  working  group,  that  is 
advising  and  evaluating  the  use  of  National  power  in  this  global  war.  We  cannot 
afford  to  win  the  battle,  but  lose  the  war  or  lose  the  peace. 

We  need  to  define  the  end  state  of  the  GWOT.  How  are  we  going  to  plot  a  path 
to  get  there  if  we  don’t  know  where  there  is?  It  has  been  said  that  this  is  a  War  of 
Generations.  In  our  society  of  instant  gratification,  short  attention  spans,  “I  want 
it  yesterday”  mentalities,  how  will  we  stay  the  course  over  the  long  haul  without 
a  destination  and  milestones  and  metrics  to  get  us  there? 

Finally,  there  are  several  documents  directly  related  to  GWOT.  We  found  that 
many  of  us  had  never  heard  of  them,  much  less  read  them.  These  are  must  reads. 
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•  Need  to  understand  this  War  on  Terror 

♦  Fundamentally  different  ideology  than  the  Cold  War 

♦  Winnable  in  what  sense?  (War  on  poverty?  War  on  Drugs?) 

•  Need  to  understand  the  enemy 

♦  Environment:  culture,  religion,  countries 

♦  Determine  the  centers  of  gravity 

♦  Sociological  Intelligence  Preparation  of  Battlefield  (not  geographical) 

♦  Are  there  parallels  to  other  “social”  challenges  (inner-city  gangs?) 

•  Need  a  common  lexicon 

♦  Definitions  and  framework 
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We  need  to  understand  our  enemy. 

-This  is  a  fundamentally  different  war  than  the  Cold  War.  At  the  height  of 
the  Cold  War,  if,  for  example,  you  brought  a  Communist  Politico  to  Wal- 
Mart,  he  would  be  amazed  at  the  wealth  of  our  country  and  at  what  an  open, 
free  market  economy  can  bring.  If  you  bring  a  terrorist  to  Wal-Mart,  all  he 
sees  is  an  example  of  the  decadence  of  the  Great  Satan. 

-The  Global  War  on  Terror  is  winnable,  but  in  what  sense?  Will  we  be  able 
to  fully  eliminate  it?  Is  it  similar  to  the  War  of  Poverty  or  the  War  on  Drugs? 

We  need  to  understand  the  centers  of  gravity  of  our  enemy,  and  the  environment 
that  spawns  him  and  her. 

-We  need  to  perform  an  Intelligence  Preparation  of  the  Battlefield.  Not  a 
geographical  one,  but  a  sociological  one  for  a  global  campaign  plan. 

-We  need  to  determine  if  there  are  parallels  to  other  social  challenges  like 
inner-city  gangs.  Is  the  despair  and  lack  of  hope  that  fuels  the  gang  similar  to 
what  fuels  terrorist  recruiting? 

We  need  a  common  lexicon  to  ensure  we’re  not  talking  past  each  other. 
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•  Analyses  of  the  application  of  National  Power 

♦  Tenets:  Military,  Diplomatic,  Economic... 

♦  Methodologies,  metrics,  and  tools 

•  Need  cooperation 

♦  Inter-Agency/Departmental/National  levels 

♦  Coordination  and  interoperability 

♦  Data,  data,  data...  (and  share  it) 

•  Distinct/immediate  challenges 

♦  Homeland  Defense/Homeland  Security 

♦  Phase  IV  of  warfare 

♦  ORSAs  in  other  agencies 

♦  Security/OPSEC  constraints 
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The  Global  War  on  Terror  will  not  be  won  through  military  power  alone.  It  will 
require  all  the  tenets  of  our  National  power  (military,  diplomatic,  economic. . .). 
Where  do  we  analyze  the  application  of  National  power?  If  the  President  asks  the 
DoD  to  solve  a  problem,  he  gets  a  military  answer;  the  State  Department,  a 
diplomatic  one.  Where  do  we  evaluate  the  apportionment  of  National  power? 
Where  are  the  methodologies,  metrics,  and  tools  to  assess  a  little  bit  of  this  and 
some  of  that? 

All  the  WGs  recognized  the  need  for  interagency,  interdepartmental,  and 
international  cooperation  and  the  ability  to  analyze  combined  actions.  However, 
stovepipes  and  the  lack  of  clearly  defined  responsibilities  make  this  difficult.  For 
example,  local  law  enforcement  agencies  do  not  wish  to  share  crime  fighting 
information  because  of  their  “OPSEC”  concerns.  We  need  to  break  down  these 
stovepipes  within  our  own  government.  Now,  these  stovepipes  are  not  surprising. 
Our  country  is  fueled  by  capitalism,  capitalism  means  competition,  and 
competition  leads  to  stovepipes.  But  for  our  future,  we  need  to  find  a  way  to 
break  these  stovepipes  down. 

We  have  some  unique  and  immediate  challenges  today.  The  DoD  is  a  player,  not 
leader,  in  these  challenges.  For  Homeland  Security,  civil  agencies  have  the  lead 
and  DoD  is  supporting.  For  the  GWOT,  the  Department  of  State  has  the  lead. 
Where  are  the  ORSAs  of  the  other  agencies?  What  is  the  venue  that  we  come 
together  in  to  provide  support  to  our  leaders?  In  what  context  can  we  assess  our 
ability  to  perform  in  this  supporting  role? 
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Preparing  the  GWOT  analysts 

•  Limited  resources,  increasing  requirements 

♦  Organize,  train,  and  equip 

•  Phenomenology  is  primarily  social,  not  physical 

♦  Social  science/political/history  training 

♦  Recruiting  into  the  ORSA  community 

•  Essential  skill  set 

♦  Ability  to  facilitate  development  relevant  metrics  for  campaign  phases 

♦  Descriptive  statistics,  ability  to  identify  trends  and  forecast  and  put  them  into  context 

♦  Actionable  analyses 

♦  Simple,  self-explanatory,  graphical  output 

•  Capturing  Lessons  Learned 

♦  Project  Camelot  -  modeling  instability  in  South  America 

♦  Combat  Analyst  website  -  joint,  coalition...? 


There  is  a  real  concern  amongst  the  working  group  about  the  increasing  need  for 
analyses  and  analysts.  There  is  a  need  for  more  analysts  within  the  Combatant 
Commands  and  analysts  that  understand  other  Department  and  Agency 
capabilities. 

If  we  believe  that  the  Global  War  on  Terror  is  fundamentally  a  different  war,  and 
a  war  of  generations,  what  are  we,  as  a  MORS  community,  doing  to  prepare 
ourselves?  The  phenomenology  of  this  war  is  primarily  social,  not  physical. 
What  are  we  doing  to  get  ourselves  the  necessary  social,  political,  and  historical 
training?  Operations  research  is  a  multidisciplinary  field.  How  are  we  attracting 
folks  with  the  right  backgrounds  and  expertise  into  our  community? 

Has  our  essential  skill  set  changed?  Is  this  war  fundamentally  different?  Are  we 
prepared? 

How  are  we  capturing  analytic  lessons  learned? 

-In  the  1960s,  the  Army  conducted  Project  Camelot  where  they  modeled 
instability  in  South  America.  Is  this  model  relevant  today?  Only  one  person 
in  the  workshop  knew  about  this  project.  How  are  we  not  losing  work  from 
the  past? 

-Both  the  AF  and  the  Army  have  developed  a  Combat  Analyst  website.  Do 
we  need  a  joint  site?  Should  we  develop  a  coalition  site? 
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Recommendations  to  Sponsors 

•  Need  a  campaign  plan  for  GWOT 

•  Identify/analyze/exploit  GWOT  centers  of  gravity 

♦  Islamic  extremism? 

♦  The  populations? 

♦  Western  influence/presence? 

•  Plan  for  the  long  term  (war  of  generations) 

♦  Title  10  -  organize,  train,  and  equip  ORSAs  for  GWOT 

♦  Expand  ORSA  talent  pool  (social  science,  political  science,...) 

•  Facilitate  coordination  across  the  government 

♦  Ability  to  analyze  the  use  of  National  power 


We  close  with  overarching  recommendations  to  our  MORS  Sponsors. 

1.  Develop  a  campaign  analysis  plan  for  the  Global  War  on  Terror.  One 
that  is  globally  strategic  and  considers  all  the  tenets  of  the  National 
power  of  the  US  and  our  allies. 

2.  Identify  and  analyze  the  centers  of  gravity  of  our  enemy.  Use  this  as  a 
basis  to  build  the  campaign  analysis  plan. 

3.  Plan  for  the  long  term.  Organize,  train,  and  equip  ORSAs  for  the  Global 
War  on  Terror.  Further,  make  a  conscious  effort  to  expand  the  pool  of 
ORSA  talent,  to  make  it  more  interdisciplinary  with  the  social  sciences. 

4.  Finally,  facilitate  the  coordination  of  analyses  across  the  government  to 
be  able  to  analyze  the  use  of  National  power. 

Finally,  it  was  agreed  by  the  SWG  members  that  this  was  an  outstanding 
workshop.  It  was  obvious  that  the  workshop  chairs  and  working  group  leads  had 
done  a  great  deal  of  preparation  and  demonstrated  strong  leadership  throughout 
the  conference.  Thank  you  for  a  great  workshop. 
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Acronyms 


ABA 

ACTOR 

AFSAA 

AOC 

BICE 

CAA 

CALL 

CDC 

CIA 

COA 

COAST 

COCOM 

CTAC 

DHS 

DIA 

DIME 

DoD 

DOT 

DPS 

DTRA 

EBO 

EEA 

EUCOM 

FAA 

FBI 

FEMA 

G1-G7 

GIS 

GWOT 

HAZMAT 

HHS 

HUMINT 

HW/SW 

VO 

IGO 

10 

J2 

J3 

J5 

JCS 


MORS  Workshop 
The  Global  War  on  Terrorism: 

Analytical  Support,  Tools,  and  Metrics  of  Assessment 

American  Bankers  Association 

Analyzing  Complex  Threats  for  Operations  and  Readiness 
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Center  for  Disease  Control 
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Defense  Intelligence  Agency 

Diplomatic,  Information,  Military  and  Economic 

Department  of  Defense 

Department  of  Transportation 

Defense  Planning  Scenarios 

Defense  Threat  Reduction  Agency 
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United  States  European  Command 

Federal  Aviation  Administration 

Federal  Bureau  of  Investigations 

Federal  Emergency  Management  Agency 
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staff,  Marine  Corps  brigade  or  higher  staff) 
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Global  War  on  Terrorism 
Hazardous  Materials 

US  Department  of  Health  and  Human  Resources 
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Joint  Staff  Intelligence  Directorate 
Joint  Staff  Operations  Directorate 
Joint  Staff  Plans  Directorate 
Joint  Chiefs  of  Staff 
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JFCOM 

Joint  Forces  Command 

JTAMDO 

Joint  Theater  Air  and  Missile  Defense  Organization 

MCO 

Major  Combat  Operations 

MDA 

Missile  Defense  Agency 

MOE 

Measure  of  Effectiveness 

MORS 

Military  Operations  Research  Society 

MSO 

Military  Strategic  Objectives 

NGB 

National  Guard  Bureau 

NGO 

Non-Governmental  Organization 

NIH 

National  Institute  of  Health 

NMSP-WOT 

Nation  Military  Strategic  Plan  for  War  on  Terrorism 

N-NC  BPG 

NORAD  -  NORTHCOM  and  the  Bi-National  Planning  Group 

NSC 

National  Security  Council 

OCR 

Office  of  Collateral  Responsibility 

OEF 

Operation  Enduring  Freedom 

OIF 

Operation  Iraqi  Freedom 

OPR 

Office  of  Primary  Responsibility 

OPSEC 

Operations  Security 

OR 

Operations  Research 

ORSA 

Operations  Research  and  System  Analysis 

OSD 

Office  of  the  Secretary  of  Defense 

PACOM 

United  States  Pacific  Command 

POC 

Point  of  Contact 

PSYOP 

Psychological  Operations 

PVO 

Private  Venture  Organization 

QDR 

Quadrennial  Defense  Review 

S&T 

Scientific  and  Technical 

SECDEF 

Secretary  of  Defense 

SIGINT 

Signals  Intelligence 

SMDC 

Space  and  Missile  Defense  Command  (Army) 

SOCOM 

United  States  Special  Operations  Command 

SWG 

Synthesis  Working  Group 

SWOT 

Strengths,  Weaknesses,  Opportunities  and  Threats 

TAP  AS 

Threat  Anticipation  Program  Agent-Based  Simulations 

TOR 

Terms  of  Reference 

TSA 

Transportation  Security  Administration 

UK 

United  Kingdom 

US 

United  States 

USA 

United  States  Army 

USAF 

United  States  Air  Force 

USAID 

US  Agency  for  International  Development 

USCG 

United  States  Coast  Guard 

USG 

United  States  Government 

USMC 

United  States  Marine  Corps 

USN 

United  States  Navy 

WMD 

Weapons  of  Mass  Destruction 
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MORS  Workshop 
The  Global  War  on  Terrorism: 

Analytical  Support,  Tools,  and  Metrics  of  Assessment 


1.  Background 

The  September  11,  2001  terrorist  attacks  on  the  World  Trade  Center  and  the 
Pentagon  have  thrust  the  United  States  into  the  Global  War  on  Terrorism  (GWOT). 
As  a  result  the  U.S.  has  joined  the  rest  of  the  world  by  entering  into  a  new  age  of 
instability.  Combating  these  terrorist  threats  has  demanded  that  our  armed  forces 
conduct  operations  simultaneously  across  the  full  spectrum  of  conflict  -  from 
conventional  combat  in  major  contingency  operations  as  in  OPERATION  IRAQI 
FREEDOM  to  peace  operations  such  as  OPERATION  JOINT  FORGE. 
Subsequently,  the  value  of  analysts  who  support  the  warfighter  has  and  will 
continue  to  be  a  significant  combat  multiplier  in  these  efforts. 

Recent  experiences  in  providing  analytic  support  to  the  combatant  commanders  in 
the  prosecution  of  the  GWOT  have  brought  to  the  fore  several  areas  that  are  of 
major  importance  and  interest  to  the  warfighter.  These  include: 

•  The  determination  of  nation  state  and  regional  instability 

•  The  conduct  of  stability  operations 

•  Analytic  Tools  to  support  the  GWOT 

•  Metrics  of  Assessment  in  the  GWOT 

•  Homeland  Defense 

•  Problem  Definition 

2.  Sponsor  Interest 

All  MORS  Sponsors  have  expressed  a  strong  interest  in  this  workshop. 

3.  Goals  and  Objectives 

The  proposed  meeting  will  provide  a  forum  for  discussing  analytic  support,  tools 
and  metrics  of  assessment  in  the  Global  War  on  Terrorism.  The  workshop  will 
bring  together  analysts  and  decision-makers  from  within  DoD  (e.g.,  Services, 
Combatant  Commands,  and  associated  Agencies),  from  other  Departments  (e.g., 
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State  and  Homeland  Security),  as  well  as  Allied  countries.  The  goal  is  to  gain 
insight  on  operational  assessment  techniques  and  capabilities  to  better  support  the 
Global  War  on  Terrorism. 

The  Global  War  on  Terrorism:  Analytic  Support,  Tools  and  Metrics  of 
Assessment  (GWOT:  ATM)  workshop  will  be  organized  into  six  working  groups 
and  one  synthesis  group.  The  six  working  groups  will  address  the  key  following 
issues;  1)  forecasting  nation  state  and  regional  instability,  2)  analytic  support  to 
stability  operations,  3)  analytic  tools  to  support  the  GWOT,  4)  metrics  of 
assessment  in  the  GWOT,  5)  homeland  defense,  and  6)  GWOT  problem  definition. 
These  working  groups  are  not  mutually  exclusive,  and  this  is  deliberate.  Explicitly 
introducing  overlap  between  the  working  groups  provides  synthesis  points  for 
integrating  the  conclusions  from  each,  and  reduces  the  probability  that  major  ideas 
will  “fall  through  the  cracks”  between  the  workshop  topics. 

WG-1  Forecasting  Nation  State  and  Regional  Instability— Identify  analytic  skills, 
tools,  models,  methods  and  metrics  for  forecasting  instability  at  the  national  and 
regional  level  that  can  be  exploited  either  by  global  terrorists  or  by  those  waging 
war  on  them.  This  working  group  will  focus  on  measuring  and  forecasting: 

•  National  and  regional  stability  in  the  absence  of  military  intervention  by  the 
U.S.  and  its  allies  as  a  precursor  to  military  intervention 

•  National  and  regional  stability  during  military  intervention  by  the  U.S.  and 
its  allies,  specifically  the  stability  effects  on  our  allies  who  have  strategic 
links  with  the  region  under  attack 

•  National  and  regional  stability  after  military  intervention  by  the  U.S.  and  its 
allies 

•  The  kinds  of  instability  that  are  beneficial  to  the  U.S.,  and  how  to  trigger 
them 

•  How  global  terrorists  will  try  to  create  or  exploit  instability,  and  how  to 
counter  them 

WG-2  Analytic  Support  to  Stability  Operations— Identify  analytic  skills,  tools, 
models,  methods  and  metrics  for  supporting  stability  operations  in  nations  and 
regions  after  military  intervention  by  the  U.S.  This  working  group  will  focus  on: 

•  The  transition  from  major  combat  operations  (MCO)  to  counter-terrorism 
and  counter  insurgency 

•  Supporting  a  political  process  that  is  both  appropriate  to  the  region  and 
culture  and  that  enhances  security 
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•  Predicting  the  actions  of  global  terrorists  in  the  nation  or  region  after  major 
combat  operations  and  after  the  U.S.  has  withdrawn 

•  Predicting  what  kind  of  actions  during  MCO  will  best  support  stability 
operations  both  during  and  after  MCO 

WG-3  GWOT:  Tools.  Data  &  Decision  Support— Identify  tools,  models,  methods 
and  metrics  for  combating  global  terrorists.  This  working  group  will  focus  on 
support  and  measures  for: 

•  Predicting  terrorist  attacks 

•  Identifying  terrorists 

•  Locating  terrorist  funds  and  funding  streams 

•  Predicting  the  effects  of  actions  taken  against  terrorists 

•  Engaging  in  a  war  of  ideas  in  the  U.S.  and  overseas 

•  Construction  of  social  networks  of  terrorist  organizations 

•  Identifying  which  individual  terrorists  to  kill,  capture  or  subvert  for 
maximum  effect 

•  Identifying  best  actions  to  take 

WG-4  Metrics  for  Assessing  Military  Effectiveness  in  the  GWOT  —  Identify  useful 
measures  of  effectiveness  to  monitor  and  improve  military  effectiveness  in  the 
Global  War  on  Terrorism.  This  working  group  will  focus  on  military 
responsibilities,  decisions,  and  activities  in  the  GWOT. 

Considering  the  strategic,  operational,  and  tactical  levels  of  warfare,  this  working 
group  will  explore  the  metrics  that  would  be  useful  in  providing  insight  to  decision 
makers  within  these  areas.  For  each  identified  metric  the  group  will  determine 
methods  and  sources  of  data  to  obtain  these  measures. 

WG-5  Homeland  Defense  -  Identify  the  issues  associated  with  1)  traditional 
military  operations  and  2)  civil  support  of  HLD  and  will  identify  useful  decision 
support  tools,  models  and  metrics  for  quantifying  the  broad  range  of  issues  facing 
HLD  decision-makers.  This  working  group  will  also  organize  these  tools,  models 
and  metrics  into  focus  areas  for  a  potential  separate  workshop  in  2005.  The  focus 
areas  for  this  working  group  will  consist  of: 

•  Traditional  military  operations  related  to  Ground-based  Missile  Defense, 
Integrated  Air  Defense  Systems,  National  Special  Security  Events,  etc. 

•  Identification  of  trigger  points  and  thresholds  for  federal  support  to  first 
responders  and  the  associated  quantitative  measures 
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•  Identification  of  measures  and  methods  for  critical  infrastructure 
identification  and  protection  including  potential  centers  of  gravity  that  could 
be  exploited  by  terrorists 

•  Identification  and  quantification  of  the  requirements  and  linkages  for 
interagency  and  first  responder  coordination  associated  with  both  natural 
disasters  and  terrorist-sponsored  attacks 

•  Identification  of  useful  modeling  and  simulation  tools  for  HLD  issues 

•  Characterization,  identification,  and  quantification  of  potential  threat  axes’ 
of  approach 

WG-6  GWOT  Problem  Definition  -  Identify  the  differences  in  terminology, 
assumptions  on  the  cause,  and  the  nature  of  the  threat  that  lead  to  confusion  and 
misdirection  of  efforts.  This  working  group  will  focus  on  defining: 

•  Different  perceptions  of  the  problem  and  the  assumptions  behind  those 
perceptions 

•  An  analytic  framework  for  understanding  the  threat 

•  Measures  and  methods  for  data  collection  for  elements  of  threat  support  and 
capability 

•  Measures  and  methods  for  assessing  vulnerabilities  and  centers  of  gravity 
that  the  U.S.  can  exploit 

Synthesis  Group— The  synthesis  group  will  bring  together  the  work  of  the  six 
working  groups  and  develop  the  overall  recommendations  from  the  analysis 
community  to  the  individual  service  operations  analysts.  As  well,  this  group  will 
provide  inputs  and  recommendations  on  development  of  analytic  support  to  the 
GWOT. 

4.  Deliverables: 

The  MORS  Synthesis  Group  will  provide  documentation  listing  actionable  items  to 
pursue  that  will  facilitate  the  ORSA  community  in  supporting  the  Global  War  on 
Terrorism.  This  will  be  in  the  form  of  a  report  and  a  briefing  to  the  MORS 
Sponsors  that  lists  state  of  the  art  assessment  methods.  These  methods  will  include 
empirical  data  collection  techniques  leading  to  the  development  of  usable  models 
for  forecasting  national  and  regional  instability  (e.g.  structural  equation  modeling). 
A  summary  of  the  report  will  be  published  in  PHALANX  and  will  be  briefed  at  the 
73rd  MORS  Symposium  in  June  2005. 

Each  working  group  will  present  a  recommended  analysis  approach  for  each  of 
their  topics,  including  a  course  of  action  for  implementing  the  approach.  These 
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suggested  approaches  will  identify  current  tools,  models,  methods  and  metrics  that 
may  be  used  in  assessing  the  effectiveness  of  the  GWOT,  for  example:  How 
successful  are  we  at  disrupting  the  financial  flows  of  terrorist  organizations?  How 
do  we  measure  the  progress  of  stability  operations?  This  will  provide  a  basis  for 
building  a  library  of  appropriate  assessment  tools. 

Further,  recommendations  for  future  workshops  and  working  group  meetings  that 
will  concentrate  on  specific  areas  will  be  proposed  for  Sponsor  consideration. 

5.  Chairs: 

Program  Co-Chairs: 

Dr.  Lynee  Murray,  NAVSEA  Newport  NUWC 
MurrayLD@npt.nuwc.navy.mil,  401-832-3543 
Dr.  Stephen  Downes-Martin,  WGD  NWC 
downess@nwc.navy.mil,  401-84 1  -6933 

Technical  Chair:  Dr.  Forrest  Crain,  Army  G3 

William.F.Crain@us.army.mil,  703-614-9120 

WG1  Chairs:  Dr.  Sean  O’Brien,  obrien@caa.army.mil,  703-806-5361 
Mr.  Tim  Hope,  thope@alionscience.com,  703-998-1611 
Mr.  H.  J.  Orgeron,  orgeronhj@mccdc.usmc.mil,  703-784-0434 
WG2  Chairs:  Dr.  Karsten  Engelmann,  engelman@caa.army.mil,  703-806-5532 
MAJ  Rob  Kewley,  kewley@caa.army.mil,  703-806-5562 
WG3  Chairs:  Dr.  Dean  Hartley,  DSHartley3@comcast.net,  865-425-9752 
Mr.  John  Cipparone,  Jcipparone@drc.com,  571-226-8765 
WG4  Chairs:  Dr.  John  Borsi,  john.borsi@pentagon.af.mil,  703-588-8198 

Lt  Col  Robert  Rosedale,  Robert.rosedale@pentagon.af.mil,  703-588-8818 
WG5  Chairs:  Mr.  Thomas  Denesia,  Thomas.denesia@northcom.mil,  719-554-9680 
Mr.  GlenRoussos,  glen.roussos@northcom.mil,  719-554-9767 
WG6  Chairs:  Dr.  David  Markowitz,  david.markowitz@osd.mil,  703-696-9360 
Mr.  Curt  Doescher,  Curt.Doescher@hqda.army.mil,  703-692-6960 
Synthesis  Chairs:  Dr.  Greg  Parnell,  Gregory.Pamell@usma.edu,  845-938-4374 
Col  Jerry  Diaz,  jerry.diaz@pentagon.af.mil,  703-588-6969 
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6.  Organizing  Committee: 


Dr.  Forrest  Crain 

Army  G3 

703-614-9120 

William.F.Crain(a), us. armv.mil 

Dr.  Stephen  Downes- 
Martin 

NWC-WGD 

401-841-6933 

downess(a>,nwc.naw.mil 

Dr.  Lynee  Murray 

NAVSEA 

NUWC 

401-832-3543 

MurravLD  (2)Nnt.NUW  C  .Naw.mil 

Dr.  Dick  Deckro 

AFIT 

937-255-6565 

x4325 

Richard .  deckro  (2),afi  t .  edu 

Mr.  Brian  Engler 

MORS 

703-933-9070 

brian(a),mors.ore 

Ms.  Natalie  Kelly 

MORS 

703-933-9070 

natali  e(S>jmors.  or  e 

Plus  All  Working  Group  Chairs  (listed  above) 

7.  Location  and  Dates 

United  States  Naval  War  College,  Newport,  Rhode  Island,  30  November  -  2 
December  2004. 

8.  Fees 

Full  Workshop:  US  Federal  Government:  $225/All  Others:  $450 
One  Day  Only:  US  Federal  Government:  $1 15/All  Others:  $230 

9.  Classification:  The  Tuesday  Plenary  Session,  Thursday  Working  Group 
Report-Out  Session  and  two  working  groups  (1  and  3)  will  be  at  the 
UNCLASSIFIED  level,  with  all  papers  Approved  for  Public  Release.  One 
working  group  (2)  will  be  at  the  UNCLASSIFIED  level,  except  for  one  session. 
Three  working  groups  (4,  5,  and  6)  will  be  at  the  classified  level. 
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10.  Agenda 


Day/Time 

Activity 

POC 

Monday 

November  29,  2004 

1700 

Working  Group  Co-Chair  Warm-Up  Session 

Workshop  Co-Chairs 

Tuesday 

November  30,  2004 

0700 

Registration  and  Continental  Breakfast 

McCarty-Little  Hall 

0800 

MORS  President's  Welcome 

Dr.  Andy  Loerch 

0805 

Facility  Host  Welcome 

TBD 

0810 

Sponsor’s  Welcome 

TBD 

0820 

Chair's  Welcome,  Workshop  Overview 

TBD 

0830 

Keynote  Speaker 

Invited  Speaker  TBD 

0930 

Break 

1000 

GWOT  Panel  Presentations 

Invited  Speakers — CJTF  7, 
CJTF  180,  Allied— TBD 

1130 

Lunch 

1230 

Guest  Speaker — NWC  (T) 

TBD 

1400 

Working  Group  Session  #1 

Working  Group  Co-Chairs 

1700 

Mixer 

Wednesday 

December  1,  2004 

0715 

Continental  Breakfast 

McCarty-Little  Hall 

0800 

Working  Group  Session  #2 

Working  Group  Co-Chairs 

0945 

Break 

1000 

Working  Group  Session  #3 

Working  Group  Co-Chairs 

1130-1300  Lunch 

1300  Working  Group  Session  #4 

1500  Break 

1515  Working  Group  Session  #5 

1700  Working  Group  Chair  &  Co-Chairs  Hot  wash 


Thursday  December  2,  2004 

0715  Continental  Breakfast  McCarty-Little  Hall 

0800  Working  Groups  Session  #6  Working  Group  Co-Chairs 

0945  Break 


Working  Group  Co-Chairs 

Working  Group  Co-Chairs 
Workshop  Chair 
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1000 

Working  Groups  Session  #7  (Prepare  Briefing) 

Working  Group  Co-Chairs 

1200-1330 

Lunch 

1330 

Working  Groups:  Present  Briefings,  WG  1,  2, 

3 

Working  Group  Co-Chairs 

1500 

Break 

1515 

Working  Groups:  Present  Briefings,  WG  4,  5 
&  6  and  Synthesis  Group 

Working  Group  Co-Chairs 

1645 

Workshop  Wrap-Up 

Workshop  Chair 

1700 

Adjourn  Workshop 

Workshop  Chair 

Friday 

December  3,  2004 

0800 

Working  Group  Co-Chairs  complete  Working 
Group  Annotated  Briefing 

Working  Group  Co-Chairs 

1200 

Adjourn  Post-Workshop  Session 

Workshop  Chair 
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Analysis  of  GWOT  Tools  Database 

DRAFT 

MORS  Workshop 
The  Global  War  on  Terrorism: 

Analytical  Support,  Tools,  and  Metrics  of  Assessment 

(Working  Group  3) 

The  accompanying  Excel  workbook  contains  two  worksheets.  The  first  is  a  Tools  versus 
Questions  worksheet  and  the  second  is  a  Tools  versus  Methods  worksheet. 


1.  Tools  vs  Questions 

The  Tools  are  grouped  by  the  categories  in  the  database:  data,  methods,  persons,  and 
tools.  The  Questions  represent  the  needs  of  the  end-users,  which  should  be  served  by  the 
Tools.  I  have  grouped  the  Questions  by  "Know?",  "Plan?",  "Do?",  "Assess?",  and 
"Support?".  (I  know  the  commas  go  inside  quotes,  but  that's  stupid  here.) 

Observing  the  grand  totals  for  tools  that  support  each  question  gives  the  impression  that 
most  of  the  questions  are  well  covered  by  tools  of  one  sort  or  another.  The  obvious 
exception  is  the  question  "What  metrics  do  we  need  to  develop?" 

Less  obvious,  is  the  lack  of  coverage  in  the  "Do?"  group.  Only  three  items  in  the 
database  address  this  group:  "Engaging  in  a  War  of  ideas  at  home  and  Abroad,"  "How  do 
we  detect  and  counter  deception?,"  and  "How  we  identify  individual  terrorist  to  kill?" 
Clearly,  there  axe  other  actions  that  are  needed  in  the  war  on  terrorism.  Obvious  actions, 
such  as  various  legal  operations,  are  not  germane  to  the  Department  of  Defense. 

However,  there  may  be  other  actions  that  the  DoD  should  be  considering.  Hence,  I  have 
added  the  question,  "How  do  we  define  &  select  other  actions?"  Some  of  the  tools  in  the 
database  may  support  this  question;  however,  other  tools  may  be  needed. 

The  number  of  tools  that  are  needed  to  address  all  of  the  questions  is  very  large,  implying 
that  consolidation,  linking,  or  expansion  of  existing  tools  would  be  helpful. 


2.  Tools  vs  Methods 

The  Tools  are  sorted  to  group  together  those  tools  that  use  the  same  methods  or  at  least  to 
get  the  ones  using  each  method  near  to  each  other.  I  have  also  grouped  the  tools  into 
Unknown,  Simulation,  Influence,  Association,  Data,  Behavior,  Language,  and  Support 
groups. 
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The  Influence  group  displays  an  obvious  weakness  in  its  total  representation;  however, 
when  only  dedicated  tools  are  counted,  weaknesses  show  up  in  simulation  and  behavior. 
Perhaps  some  of  the  tools  with  unknown  methods  actually  reinforce  some  of  these 
groups. 

The  number  of  tools  that  are  needed  to  use  all  of  the  methods  is  very  large,  implying  that 
consolidation,  linking,  or  expansion  of  existing  tools  would  be  helpful. 


3.  Recommendations 

Six  recommendations  can  be  based  on  this  analysis: 

•  More  work  is  required  to  develop  metrics; 

•  Work  is  needed  to  determine  what  other  alternative  actions  might  aid  the 
GWOT; 

•  Influence  methods  need  to  be  better  developed; 

•  Actual  simulations  need  to  be  developed; 

•  More  behavior  tools  are  needed;  and 

•  Consolidation,  linking,  or  expansion  of  existing  tools  would  be  helpful. 


Appendix  Ca  -  2 


GWOT  Tools  Database 
(Working  Group  3) 
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GWOT  Tools  Database 
(Working  Group  3) 


OT  Tools  Database 
forking  Group  3) 
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GWOT  Tools  Database 
(Working  Group  3) 
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